Jul 18 00:54:59.139119 ip-10-0-133-101 systemd[1]: Starting Kubernetes Kubelet... Jul 18 00:54:59.583306 ip-10-0-133-101 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:54:59.583306 ip-10-0-133-101 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 18 00:54:59.583306 ip-10-0-133-101 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:54:59.583306 ip-10-0-133-101 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 18 00:54:59.583306 ip-10-0-133-101 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 18 00:54:59.584571 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.584409 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593654 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593677 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593681 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593684 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593687 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593690 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593693 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593696 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:59.593687 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593699 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593702 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593705 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593707 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593710 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593713 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593715 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593719 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593721 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593724 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593727 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593729 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593732 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593734 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593737 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593739 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593741 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593744 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593746 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593749 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:59.594019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593752 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593754 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593756 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593759 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593763 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593768 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593770 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593773 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593776 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593779 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593781 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593784 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593787 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593789 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593793 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593795 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593798 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593801 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593803 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593806 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:59.594502 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593808 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593811 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593813 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593816 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593818 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593821 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593823 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593826 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593828 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593832 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593834 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593837 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593840 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593842 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593845 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593847 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593850 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593866 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593871 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593875 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:59.595031 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593880 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593884 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593886 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593895 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593899 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593903 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593907 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593910 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593913 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593915 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593917 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593921 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593924 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593926 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593929 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593932 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593934 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593937 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593941 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:59.595522 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593945 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593948 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593951 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593953 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593956 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593958 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593961 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593964 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593966 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593968 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593971 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.593973 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594681 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594688 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594691 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594695 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594699 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594703 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594707 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:59.596032 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594710 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594713 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594716 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594719 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594722 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594724 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594727 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594730 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594732 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594734 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594738 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594740 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594743 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594746 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594748 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594750 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594753 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594755 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594758 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594760 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:59.596488 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594762 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594765 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594768 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594770 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594772 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594776 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594778 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594781 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594783 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594786 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594789 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594792 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594794 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594797 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594799 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594802 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594804 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594806 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594809 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594811 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:59.597042 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594813 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594816 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594818 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594823 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594827 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594830 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594833 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594835 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594838 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594840 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594843 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594845 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594848 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594850 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594872 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594876 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594880 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594884 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594888 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594891 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:59.597580 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594893 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594896 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594900 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594904 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594907 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594910 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594912 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594916 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594919 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594922 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594925 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594927 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594930 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594932 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594935 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594937 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594941 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594943 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594946 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594948 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:59.598085 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594950 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594952 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594955 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594957 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594960 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594962 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594965 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594967 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594969 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594972 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594975 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.594978 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595358 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595363 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595366 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595369 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595372 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595374 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595377 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:59.598560 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595380 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595382 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595385 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595388 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595391 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595393 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595395 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595398 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595401 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595404 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595406 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595410 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595413 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595416 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595419 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595422 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595424 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595427 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595430 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:59.599041 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595432 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595435 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595437 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595440 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595442 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595445 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595447 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595450 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595453 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595456 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595458 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595461 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595463 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595465 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595468 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595470 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595472 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595475 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595477 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595480 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:59.599497 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595482 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595485 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595487 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595490 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595492 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595494 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595497 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595499 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595502 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595504 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595506 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595511 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595513 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595516 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595519 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595522 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595524 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595527 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595529 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595532 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:59.600019 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595534 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595537 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595539 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595542 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595544 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595547 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595549 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595551 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595554 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595556 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595558 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595562 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595564 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595567 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595570 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595574 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595577 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595580 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595583 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:59.600501 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595586 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595588 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595591 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595594 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595600 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595602 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595605 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595609 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595611 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595614 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595617 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595619 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595621 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.595624 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595700 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595708 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595714 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595719 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595727 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595732 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595738 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595744 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 18 00:54:59.600969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595749 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595755 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595758 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595762 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595765 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595768 2556 flags.go:64] FLAG: --cgroup-root="" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595770 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595773 2556 flags.go:64] FLAG: --client-ca-file="" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595777 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595780 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595784 2556 flags.go:64] FLAG: --cluster-domain="" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595787 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595790 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595793 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595799 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595803 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595806 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595810 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595814 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595817 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595820 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595823 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595826 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595828 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 18 00:54:59.601505 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595832 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595836 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595839 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595842 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595845 2556 flags.go:64] FLAG: --enable-server="true" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595847 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595866 2556 flags.go:64] FLAG: --event-burst="100" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595869 2556 flags.go:64] FLAG: --event-qps="50" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595872 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595875 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595877 2556 flags.go:64] FLAG: --eviction-hard="" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595881 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595884 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595887 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595890 2556 flags.go:64] FLAG: --eviction-soft="" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595892 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595895 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595903 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595906 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595909 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595912 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595914 2556 flags.go:64] FLAG: --feature-gates="" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595919 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595922 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595926 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 18 00:54:59.602091 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595930 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595934 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595936 2556 flags.go:64] FLAG: --help="false" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595939 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595943 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595945 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595948 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595952 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595955 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595958 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595961 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595963 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595966 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595969 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595972 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595974 2556 flags.go:64] FLAG: --kube-reserved="" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595977 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595980 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595983 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595985 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595988 2556 flags.go:64] FLAG: --lock-file="" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595991 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595993 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.595996 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 18 00:54:59.602709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596002 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596005 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596008 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596010 2556 flags.go:64] FLAG: --logging-format="text" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596013 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596017 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596020 2556 flags.go:64] FLAG: --manifest-url="" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596023 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596029 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596031 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596036 2556 flags.go:64] FLAG: --max-pods="110" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596039 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596042 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596045 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596048 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596051 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596054 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596057 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596064 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596067 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596070 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596073 2556 flags.go:64] FLAG: --pod-cidr="" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596076 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 18 00:54:59.603379 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596081 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596084 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596087 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596090 2556 flags.go:64] FLAG: --port="10250" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596093 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596096 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dd1a0e29b8a3e27d" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596099 2556 flags.go:64] FLAG: --qos-reserved="" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596102 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596104 2556 flags.go:64] FLAG: --register-node="true" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596107 2556 flags.go:64] FLAG: --register-with-taints="" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596110 2556 flags.go:64] FLAG: --registry-burst="10" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596114 2556 flags.go:64] FLAG: --registry-qps="5" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596117 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596120 2556 flags.go:64] FLAG: --reserved-memory="" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596123 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596127 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596130 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596134 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596137 2556 flags.go:64] FLAG: --runonce="false" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596140 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596143 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596146 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596149 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596151 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596155 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596158 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 18 00:54:59.604043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596161 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596163 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596166 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596169 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596171 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596174 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596177 2556 flags.go:64] FLAG: --system-cgroups="" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596180 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596185 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596188 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596190 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596194 2556 flags.go:64] FLAG: --tls-min-version="" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596197 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596199 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596202 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596205 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596208 2556 flags.go:64] FLAG: --v="2" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596212 2556 flags.go:64] FLAG: --version="false" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596216 2556 flags.go:64] FLAG: --vmodule="" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596220 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.596223 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596344 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596347 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596352 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:59.604678 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596355 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596358 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596361 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596363 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596366 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596368 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596370 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596373 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596376 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596378 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596380 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596383 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596385 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596387 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596390 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596392 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596395 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596397 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596399 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596403 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:59.605277 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596407 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596421 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596425 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596429 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596432 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596435 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596438 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596442 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596444 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596447 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596449 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596453 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596455 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596458 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596460 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596463 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596465 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596467 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596470 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:59.605764 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596472 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596474 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596477 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596479 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596482 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596484 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596486 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596489 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596491 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596494 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596497 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596499 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596502 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596504 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596507 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596509 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596511 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596514 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596517 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596519 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:59.606275 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596522 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596525 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596528 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596532 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596537 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596540 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596542 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596545 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596547 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596551 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596554 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596557 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596559 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596562 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596564 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596567 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596569 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596571 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596574 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:59.606776 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596576 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596578 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596581 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596584 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596586 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596588 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596591 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596593 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596597 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596601 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596603 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596606 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596608 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596611 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596613 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596616 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596619 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:59.607328 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.596623 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.597490 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.604319 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.604335 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.604357 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.604362 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604424 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604429 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604433 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604436 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604439 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604442 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604445 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604448 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:59.607730 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604450 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604453 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604456 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604461 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604464 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604467 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604470 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604473 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604475 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604478 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604481 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604483 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604486 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604489 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604491 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604494 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604498 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604502 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604505 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:59.608097 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604508 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604511 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604514 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604517 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604519 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604522 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604525 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604528 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604530 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604533 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604535 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604538 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604540 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604543 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604545 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604548 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604550 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604553 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604555 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604557 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:59.608552 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604560 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604562 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604565 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604567 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604570 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604572 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604575 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604577 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604579 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604582 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604585 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604587 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604589 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604592 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604595 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604598 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604600 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604603 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604606 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604608 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:59.609039 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604611 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604613 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604616 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604618 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604621 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604623 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604625 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604628 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604630 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604633 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604635 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604638 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604640 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604643 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604645 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604648 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604650 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604653 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604655 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604658 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:59.609532 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604661 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604664 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604666 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604670 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604672 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604674 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604679 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604682 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604685 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604688 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604691 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604694 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.604699 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604809 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604814 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 18 00:54:59.610069 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604817 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604820 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604823 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604826 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604828 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604831 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604834 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604837 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604840 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604843 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604845 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604847 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604850 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604867 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604870 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604874 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604876 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604879 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604882 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604886 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 18 00:54:59.610442 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604889 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604892 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604895 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604898 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604900 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604903 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604905 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604908 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604910 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604913 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604915 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604917 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604920 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604922 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604925 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604927 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604930 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604932 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604935 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604938 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 18 00:54:59.610995 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604940 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604943 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604945 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604947 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604950 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604953 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604955 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604958 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604961 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604963 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604966 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604968 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604971 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604973 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604980 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604983 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604986 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604988 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604991 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604993 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 18 00:54:59.611476 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604996 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.604999 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605001 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605004 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605006 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605008 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605011 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605013 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605016 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605018 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605020 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605023 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605025 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605028 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605030 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605033 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605035 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605038 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605040 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 18 00:54:59.611974 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605043 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605045 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605048 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605050 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605053 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605055 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605059 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605062 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605066 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605069 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605073 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605076 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605079 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605082 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605085 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605088 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605090 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 18 00:54:59.612427 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:54:59.605093 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.605098 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.605208 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.607200 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.608605 2556 server.go:1019] "Starting client certificate rotation" Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.608705 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.608739 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.611134 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:54:59.612839 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.612725 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 18 00:54:59.621828 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.621811 2556 log.go:25] "Validated CRI v1 runtime API" Jul 18 00:54:59.625496 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.625474 2556 log.go:25] "Validated CRI v1 image API" Jul 18 00:54:59.626373 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.626356 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 18 00:54:59.631250 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.631228 2556 fs.go:135] Filesystem UUIDs: map[4f7e62a0-0e05-4b34-9341-7bcaa9e1ab62:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9868414c-eb3f-4e27-b276-c2710148a71b:/dev/nvme0n1p4] Jul 18 00:54:59.631319 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.631249 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 18 00:54:59.636215 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.636102 2556 manager.go:216] Machine: {Timestamp:2026-07-18 00:54:59.634750438 +0000 UTC m=+0.366675267 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3058113 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b9c2ca4cfd081a51e744844f4da2a SystemUUID:ec2b9c2c-a4cf-d081-a51e-744844f4da2a BootID:af1d339a-5de1-4c64-8762-fce49c3118f9 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f2:52:22:1f:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f2:52:22:1f:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:00:2d:b1:44:6d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 18 00:54:59.636215 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.636207 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 18 00:54:59.636326 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.636284 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 18 00:54:59.639446 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.639413 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 18 00:54:59.639586 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.639448 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 18 00:54:59.640007 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.639986 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:54:59.640149 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.640136 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 18 00:54:59.640149 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.640151 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 18 00:54:59.640239 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.640159 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:54:59.640937 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.640927 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 18 00:54:59.642236 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.642226 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 18 00:54:59.645768 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.645757 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:54:59.645901 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.645891 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 18 00:54:59.645941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.645923 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 18 00:54:59.645969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.645944 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 18 00:54:59.645969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.645965 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 18 00:54:59.646025 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.645977 2556 kubelet.go:398] "Adding apiserver pod source" Jul 18 00:54:59.646025 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.645987 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 18 00:54:59.646352 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.646341 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:54:59.646389 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.646359 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 18 00:54:59.649241 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.649223 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 18 00:54:59.651075 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.651059 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 18 00:54:59.651161 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.651098 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 18 00:54:59.652300 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652287 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 18 00:54:59.652367 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652307 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 18 00:54:59.652367 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652316 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 18 00:54:59.652367 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652324 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 18 00:54:59.652367 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652337 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 18 00:54:59.652367 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652345 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 18 00:54:59.652367 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652357 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 18 00:54:59.652367 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652365 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 18 00:54:59.652586 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652376 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 18 00:54:59.652586 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652384 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 18 00:54:59.652586 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652397 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 18 00:54:59.652586 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.652405 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 18 00:54:59.653243 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.653232 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 18 00:54:59.653299 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.653246 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 18 00:54:59.656419 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.656404 2556 server.go:1268] "Started kubelet" Jul 18 00:54:59.656583 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.656539 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 18 00:54:59.656682 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.656578 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 18 00:54:59.656682 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.656638 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 18 00:54:59.657287 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.657257 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 18 00:54:59.657377 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.657353 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 18 00:54:59.657377 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.657362 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 18 00:54:59.657328 ip-10-0-133-101 systemd[1]: Started Kubernetes Kubelet. Jul 18 00:54:59.658607 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.658590 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 18 00:54:59.658699 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.658688 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 18 00:54:59.663053 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.663009 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4whc" Jul 18 00:54:59.663846 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.663827 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 18 00:54:59.667518 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.666501 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-101.ec2.internal.18c33c3a93ec90de default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-101.ec2.internal,UID:ip-10-0-133-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-101.ec2.internal,},FirstTimestamp:2026-07-18 00:54:59.656372446 +0000 UTC m=+0.388297255,LastTimestamp:2026-07-18 00:54:59.656372446 +0000 UTC m=+0.388297255,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-101.ec2.internal,}" Jul 18 00:54:59.667959 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.667933 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4whc" Jul 18 00:54:59.667959 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.667938 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 18 00:54:59.668098 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.667980 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 18 00:54:59.668225 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.668206 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:54:59.668704 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.668674 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 18 00:54:59.668704 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.668674 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 18 00:54:59.668704 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.668699 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 18 00:54:59.668898 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.668785 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 18 00:54:59.668898 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.668795 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 18 00:54:59.669025 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.669007 2556 factory.go:55] Registering systemd factory Jul 18 00:54:59.669075 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.669035 2556 factory.go:223] Registration of the systemd container factory successfully Jul 18 00:54:59.669328 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.669300 2556 factory.go:153] Registering CRI-O factory Jul 18 00:54:59.669328 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.669325 2556 factory.go:223] Registration of the crio container factory successfully Jul 18 00:54:59.669463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.669379 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 18 00:54:59.669463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.669409 2556 factory.go:103] Registering Raw factory Jul 18 00:54:59.669463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.669426 2556 manager.go:1196] Started watching for new ooms in manager Jul 18 00:54:59.670114 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.670097 2556 manager.go:349] Starting recovery of all containers Jul 18 00:54:59.679955 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.679934 2556 manager.go:354] Recovery completed Jul 18 00:54:59.681272 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.681250 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:54:59.684401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.684389 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:59.686781 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.686767 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:59.686867 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.686794 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:59.686867 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.686804 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:59.687261 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.687240 2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-101.ec2.internal\" not found" node="ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.687441 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.687428 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 18 00:54:59.687493 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.687441 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 18 00:54:59.687493 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.687460 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 18 00:54:59.687493 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.687478 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:59.689398 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.689386 2556 policy_none.go:49] "None policy: Start" Jul 18 00:54:59.689443 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.689403 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 18 00:54:59.689443 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.689413 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 18 00:54:59.691404 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.691389 2556 policy_none.go:47] "Start" Jul 18 00:54:59.691533 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.691520 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:59.691593 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.691549 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:59.691593 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.691564 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:59.727633 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.727445 2556 manager.go:337] "Starting Device Plugin manager" Jul 18 00:54:59.727754 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.727664 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 18 00:54:59.727754 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.727678 2556 server.go:87] "Starting device plugin registration server" Jul 18 00:54:59.727975 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.727960 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 18 00:54:59.728053 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.727976 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 18 00:54:59.728127 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.728108 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 18 00:54:59.728210 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.728197 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 18 00:54:59.728261 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.728213 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 18 00:54:59.728734 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.728713 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 18 00:54:59.728824 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.728759 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:54:59.800059 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.800023 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 18 00:54:59.802228 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.801408 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 18 00:54:59.802228 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.801455 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 18 00:54:59.802228 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.801484 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 18 00:54:59.802228 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.801525 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 18 00:54:59.804332 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.804306 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:54:59.828763 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.828737 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:59.829789 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.829771 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:59.829915 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.829805 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:59.829915 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.829819 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:59.829915 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.829868 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.835929 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.835885 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.835929 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.835908 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-101.ec2.internal\": node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:54:59.848311 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.848289 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:54:59.902677 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.902643 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal"] Jul 18 00:54:59.902809 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.902734 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:59.905541 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.905523 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:59.905648 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.905559 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:59.905648 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.905571 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:59.907804 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.907786 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:59.907927 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.907912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.907990 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.907947 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:59.908677 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.908660 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:59.908759 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.908665 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:59.908759 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.908709 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:59.908759 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.908727 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:59.908759 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.908686 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:59.908759 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.908756 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:59.910896 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.910881 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.910977 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.910911 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 18 00:54:59.911708 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.911690 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientMemory" Jul 18 00:54:59.911786 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.911724 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 18 00:54:59.911786 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:54:59.911739 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeHasSufficientPID" Jul 18 00:54:59.929478 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.929450 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-101.ec2.internal\" not found" node="ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.932756 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.932738 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-101.ec2.internal\" not found" node="ip-10-0-133-101.ec2.internal" Jul 18 00:54:59.948518 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:54:59.948492 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:00.048769 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:00.048733 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:00.070087 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.070059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f3eb8112d8d583103163638d540f440-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal\" (UID: \"7f3eb8112d8d583103163638d540f440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.070172 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.070088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f3eb8112d8d583103163638d540f440-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal\" (UID: \"7f3eb8112d8d583103163638d540f440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.070172 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.070107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ded9cd7b6d6d15858bf2deecb597081d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-101.ec2.internal\" (UID: \"ded9cd7b6d6d15858bf2deecb597081d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.149471 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:00.149404 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:00.170780 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.170744 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f3eb8112d8d583103163638d540f440-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal\" (UID: \"7f3eb8112d8d583103163638d540f440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.170834 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.170786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ded9cd7b6d6d15858bf2deecb597081d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-101.ec2.internal\" (UID: \"ded9cd7b6d6d15858bf2deecb597081d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.170834 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.170816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f3eb8112d8d583103163638d540f440-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal\" (UID: \"7f3eb8112d8d583103163638d540f440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.170958 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.170876 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f3eb8112d8d583103163638d540f440-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal\" (UID: \"7f3eb8112d8d583103163638d540f440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.170958 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.170894 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f3eb8112d8d583103163638d540f440-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal\" (UID: \"7f3eb8112d8d583103163638d540f440\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.170958 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.170905 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ded9cd7b6d6d15858bf2deecb597081d-config\") pod \"kube-apiserver-proxy-ip-10-0-133-101.ec2.internal\" (UID: \"ded9cd7b6d6d15858bf2deecb597081d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.232946 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.232915 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.236074 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:00.236053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" Jul 18 00:55:00.250183 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:00.250163 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:00.350725 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:00.350681 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:01.657370 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:01.657328 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:01.757909 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:01.757864 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:01.814378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:01.814352 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 18 00:55:01.814767 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:01.814506 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:55:01.814767 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:01.814531 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 18 00:55:01.858870 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:01.858842 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:01.878892 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:01.878805 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 00:50:00 +0000 UTC" deadline="2028-02-07 10:06:30.132678441 +0000 UTC" Jul 18 00:55:01.878892 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:01.878835 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13665h11m28.253846628s" Jul 18 00:55:01.958956 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:01.958919 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:01.997474 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:01.997445 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:55:02.059414 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.059375 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:02.159899 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.159826 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:02.235803 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:02.235759 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f3eb8112d8d583103163638d540f440.slice/crio-ecbcc0b8efb445f9573b17082e010ab429f87f438b1ba9c44dba3a8d7471697c WatchSource:0}: Error finding container ecbcc0b8efb445f9573b17082e010ab429f87f438b1ba9c44dba3a8d7471697c: Status 404 returned error can't find the container with id ecbcc0b8efb445f9573b17082e010ab429f87f438b1ba9c44dba3a8d7471697c Jul 18 00:55:02.236264 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:02.236239 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded9cd7b6d6d15858bf2deecb597081d.slice/crio-9e9682705e2d2287aba725159ac740895f39f4c3b460dfe5f5f9eab85f19f561 WatchSource:0}: Error finding container 9e9682705e2d2287aba725159ac740895f39f4c3b460dfe5f5f9eab85f19f561: Status 404 returned error can't find the container with id 9e9682705e2d2287aba725159ac740895f39f4c3b460dfe5f5f9eab85f19f561 Jul 18 00:55:02.239881 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.239867 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 00:55:02.260488 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.260458 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:02.361364 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.361315 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-101.ec2.internal\" not found" Jul 18 00:55:02.397904 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.397876 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:55:02.474907 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.474824 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" Jul 18 00:55:02.484929 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.484906 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:55:02.486086 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.486073 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" Jul 18 00:55:02.494646 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.494629 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 18 00:55:02.705568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.705543 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:55:02.853065 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.852739 2556 apiserver.go:52] "Watching apiserver" Jul 18 00:55:02.861786 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.861757 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 18 00:55:02.863410 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.862951 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-px7qh","openshift-network-operator/iptables-alerter-ff4kz","openshift-ovn-kubernetes/ovnkube-node-4njhd","kube-system/global-pull-secret-syncer-6xngz","kube-system/konnectivity-agent-w8qlp","kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r","openshift-cluster-node-tuning-operator/tuned-zhl62","openshift-image-registry/node-ca-f58nz","openshift-multus/multus-t7jcb","openshift-multus/network-metrics-daemon-9fhcl","openshift-dns/node-resolver-9sqfs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal","openshift-multus/multus-additional-cni-plugins-v5xxj"] Jul 18 00:55:02.865707 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.865684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.867811 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.867785 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:02.873735 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.867894 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:02.873847 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.873776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.873907 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.873854 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:02.874359 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.874331 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.875378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.874534 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 18 00:55:02.875378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.874593 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 18 00:55:02.875378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.875155 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 18 00:55:02.875378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.875257 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 18 00:55:02.876078 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.876057 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qvdrm\"" Jul 18 00:55:02.879158 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.878468 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 18 00:55:02.879158 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.878566 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 18 00:55:02.879158 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.878860 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 18 00:55:02.879368 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.879312 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 18 00:55:02.882279 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.882259 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 18 00:55:02.882562 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.882526 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c27c7\"" Jul 18 00:55:02.884072 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.883820 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 18 00:55:02.884961 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.884939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.885067 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.884980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.885267 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885248 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:02.885633 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqmrb\" (UniqueName: \"kubernetes.io/projected/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-kube-api-access-jqmrb\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:02.885714 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-node-log\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.885769 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885720 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovnkube-config\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.885807 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wsd\" (UniqueName: \"kubernetes.io/projected/5a5f891a-1db5-40be-b4f8-e261cadbe47f-kube-api-access-p9wsd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.885877 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.885937 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885890 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh8pw\" (UniqueName: \"kubernetes.io/projected/cce9c81d-7910-46eb-a9cd-553091418db6-kube-api-access-wh8pw\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.885937 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-systemd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.885937 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-etc-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886105 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-log-socket\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886105 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-cni-netd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886105 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.885981 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-socket-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.886105 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-registration-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.886105 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-slash\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-var-lib-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-env-overrides\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovn-node-metrics-cert\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886206 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22ca3617-ae2d-49ea-a5e8-42287275a957-dbus\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/387b636d-e2b9-4dec-a8be-c03e24d54dfa-agent-certs\") pod \"konnectivity-agent-w8qlp\" (UID: \"387b636d-e2b9-4dec-a8be-c03e24d54dfa\") " pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886284 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/387b636d-e2b9-4dec-a8be-c03e24d54dfa-konnectivity-ca\") pod \"konnectivity-agent-w8qlp\" (UID: \"387b636d-e2b9-4dec-a8be-c03e24d54dfa\") " pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-kubelet\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-cni-bin\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-device-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-systemd-units\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886470 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-run-netns\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-ovn\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-run-ovn-kubernetes\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886687 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-sys-fs\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.886742 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886727 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.887169 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovnkube-script-lib\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.887169 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.886795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22ca3617-ae2d-49ea-a5e8-42287275a957-kubelet-config\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.888819 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.888194 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b9xjd\"" Jul 18 00:55:02.888819 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.888217 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 18 00:55:02.888819 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.888229 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 18 00:55:02.888819 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.888457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:02.888819 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.888698 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ncdnl\"" Jul 18 00:55:02.888819 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.888733 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 18 00:55:02.889126 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.888991 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 18 00:55:02.889278 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.889245 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 18 00:55:02.889356 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.889340 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 18 00:55:02.889409 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.889350 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 18 00:55:02.890482 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.890462 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 18 00:55:02.890704 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.890685 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ztncn\"" Jul 18 00:55:02.891141 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.891121 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 18 00:55:02.891244 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.891186 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.891964 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.891943 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 18 00:55:02.892199 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.892182 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 18 00:55:02.893564 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.893546 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:02.893771 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.893754 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 18 00:55:02.894002 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.893984 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rxr25\"" Jul 18 00:55:02.894115 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.894082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:02.897398 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.896305 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.897398 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.896562 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t6frr\"" Jul 18 00:55:02.897398 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.896720 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:55:02.897398 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.896851 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 18 00:55:02.897398 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.896879 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 18 00:55:02.899457 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.898285 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vm5f4\"" Jul 18 00:55:02.899457 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.898569 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 18 00:55:02.899457 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.899239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:02.899457 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.899300 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:02.901390 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.901373 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:02.903713 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.903682 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 18 00:55:02.903816 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.903682 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rqbqs\"" Jul 18 00:55:02.903929 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.903689 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 18 00:55:02.909488 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.909450 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-986v7" Jul 18 00:55:02.921313 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.919345 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-986v7" Jul 18 00:55:02.976228 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.976200 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 18 00:55:02.987027 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.986980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-var-lib-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987159 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987033 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovn-node-metrics-cert\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987159 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987102 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-var-lib-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987269 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22ca3617-ae2d-49ea-a5e8-42287275a957-dbus\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.987269 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987199 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/387b636d-e2b9-4dec-a8be-c03e24d54dfa-agent-certs\") pod \"konnectivity-agent-w8qlp\" (UID: \"387b636d-e2b9-4dec-a8be-c03e24d54dfa\") " pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:02.987269 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987224 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/387b636d-e2b9-4dec-a8be-c03e24d54dfa-konnectivity-ca\") pod \"konnectivity-agent-w8qlp\" (UID: \"387b636d-e2b9-4dec-a8be-c03e24d54dfa\") " pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:02.987269 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987254 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-cnibin\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.987463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-multus-certs\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.987463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-kubelet\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-device-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.987463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-iptables-alerter-script\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:02.987463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cnibin\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.987463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987463 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-run-ovn-kubernetes\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-sys-fs\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987468 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-device-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987572 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/22ca3617-ae2d-49ea-a5e8-42287275a957-dbus\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987661 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-run-ovn-kubernetes\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-kubelet\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.987775 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987697 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-sys-fs\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.988055 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d25b940b-1f11-4a80-97d4-25b616df01c5-tmp\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.988055 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.987981 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.988055 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovnkube-script-lib\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.988055 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysctl-d\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-lib-modules\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988079 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/387b636d-e2b9-4dec-a8be-c03e24d54dfa-konnectivity-ca\") pod \"konnectivity-agent-w8qlp\" (UID: \"387b636d-e2b9-4dec-a8be-c03e24d54dfa\") " pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988094 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysctl-conf\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988090 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988142 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wnj7\" (UniqueName: \"kubernetes.io/projected/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-kube-api-access-5wnj7\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdkmb\" (UniqueName: \"kubernetes.io/projected/a6d5b666-4557-4d4f-a832-ba629e3d3496-kube-api-access-kdkmb\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.988188 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988285 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-cni-multus\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysconfig\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-kubernetes\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.988337 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6d5b666-4557-4d4f-a832-ba629e3d3496-hosts-file\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.988395 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret podName:22ca3617-ae2d-49ea-a5e8-42287275a957 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:03.488378169 +0000 UTC m=+3.014141822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret") pod "global-pull-secret-syncer-6xngz" (UID: "22ca3617-ae2d-49ea-a5e8-42287275a957") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988432 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87p6c\" (UniqueName: \"kubernetes.io/projected/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-kube-api-access-87p6c\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-system-cni-dir\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhnq\" (UniqueName: \"kubernetes.io/projected/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-kube-api-access-rfhnq\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-node-log\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovnkube-config\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988633 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wsd\" (UniqueName: \"kubernetes.io/projected/5a5f891a-1db5-40be-b4f8-e261cadbe47f-kube-api-access-p9wsd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988660 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988690 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovnkube-script-lib\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh8pw\" (UniqueName: \"kubernetes.io/projected/cce9c81d-7910-46eb-a9cd-553091418db6-kube-api-access-wh8pw\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-system-cni-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-k8s-cni-cncf-io\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988803 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-log-socket\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988860 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-cni-netd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d5b666-4557-4d4f-a832-ba629e3d3496-tmp-dir\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988904 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-os-release\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.988955 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-slash\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovnkube-config\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-env-overrides\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-sys\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989058 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-log-socket\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-socket-dir-parent\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-etc-kubernetes\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989195 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-cni-bin\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989259 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-host\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-cni-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989296 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-cni-netd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-node-log\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.989411 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:02.989796 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989440 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-cni-bin\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989460 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a5f891a-1db5-40be-b4f8-e261cadbe47f-env-overrides\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:02.989477 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs podName:f01ef9a9-c90f-4009-8ae4-1c6dc5691867 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:03.489460988 +0000 UTC m=+3.015224680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs") pod "network-metrics-daemon-9fhcl" (UID: "f01ef9a9-c90f-4009-8ae4-1c6dc5691867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989478 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-slash\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-daemon-config\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989511 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-host-slash\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989540 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-systemd-units\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-run-netns\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-ovn\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-modprobe-d\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989631 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-host-run-netns\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-systemd\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989667 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-systemd-units\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989686 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-ovn\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s56g\" (UniqueName: \"kubernetes.io/projected/d25b940b-1f11-4a80-97d4-25b616df01c5-kube-api-access-7s56g\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-netns\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.990497 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989811 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22ca3617-ae2d-49ea-a5e8-42287275a957-kubelet-config\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-host\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-tuned\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-cni-binary-copy\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-conf-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.989982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqmrb\" (UniqueName: \"kubernetes.io/projected/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-kube-api-access-jqmrb\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990064 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snvg4\" (UniqueName: \"kubernetes.io/projected/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-kube-api-access-snvg4\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990087 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-run\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-var-lib-kubelet\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-kubelet\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990160 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-serviceca\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-cni-bin\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-hostroot\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-systemd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.991068 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-etc-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990365 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-socket-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990415 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-registration-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-os-release\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990563 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/22ca3617-ae2d-49ea-a5e8-42287275a957-kubelet-config\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990645 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-etc-selinux\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.990977 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-run-systemd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.991043 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a5f891a-1db5-40be-b4f8-e261cadbe47f-etc-openvswitch\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.991141 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-socket-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.991665 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.991191 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cce9c81d-7910-46eb-a9cd-553091418db6-registration-dir\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:02.992172 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.991925 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a5f891a-1db5-40be-b4f8-e261cadbe47f-ovn-node-metrics-cert\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:02.992172 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:02.992031 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/387b636d-e2b9-4dec-a8be-c03e24d54dfa-agent-certs\") pod \"konnectivity-agent-w8qlp\" (UID: \"387b636d-e2b9-4dec-a8be-c03e24d54dfa\") " pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:03.001590 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.001568 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh8pw\" (UniqueName: \"kubernetes.io/projected/cce9c81d-7910-46eb-a9cd-553091418db6-kube-api-access-wh8pw\") pod \"aws-ebs-csi-driver-node-jrh5r\" (UID: \"cce9c81d-7910-46eb-a9cd-553091418db6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:03.002901 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.002873 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wsd\" (UniqueName: \"kubernetes.io/projected/5a5f891a-1db5-40be-b4f8-e261cadbe47f-kube-api-access-p9wsd\") pod \"ovnkube-node-4njhd\" (UID: \"5a5f891a-1db5-40be-b4f8-e261cadbe47f\") " pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:03.003371 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.003351 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqmrb\" (UniqueName: \"kubernetes.io/projected/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-kube-api-access-jqmrb\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:03.013716 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.013663 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" event={"ID":"ded9cd7b6d6d15858bf2deecb597081d","Type":"ContainerStarted","Data":"9e9682705e2d2287aba725159ac740895f39f4c3b460dfe5f5f9eab85f19f561"} Jul 18 00:55:03.014725 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.014697 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" event={"ID":"7f3eb8112d8d583103163638d540f440","Type":"ContainerStarted","Data":"ecbcc0b8efb445f9573b17082e010ab429f87f438b1ba9c44dba3a8d7471697c"} Jul 18 00:55:03.091740 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snvg4\" (UniqueName: \"kubernetes.io/projected/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-kube-api-access-snvg4\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:03.091905 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-run\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.091905 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091797 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-var-lib-kubelet\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.091905 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-kubelet\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.091905 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-serviceca\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:03.091905 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091866 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-run\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.091905 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091878 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-cni-bin\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.091905 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-hostroot\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091929 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-kubelet\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091937 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-os-release\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091983 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-var-lib-kubelet\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091984 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-cni-bin\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.091963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092202 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-hostroot\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-cnibin\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092258 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.092622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-multus-certs\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092263 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-os-release\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.092622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-multus-certs\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092309 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-iptables-alerter-script\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:03.092622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cnibin\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.092622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d25b940b-1f11-4a80-97d4-25b616df01c5-tmp\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092594 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysctl-d\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-lib-modules\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092667 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysctl-conf\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wnj7\" (UniqueName: \"kubernetes.io/projected/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-kube-api-access-5wnj7\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdkmb\" (UniqueName: \"kubernetes.io/projected/a6d5b666-4557-4d4f-a832-ba629e3d3496-kube-api-access-kdkmb\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092789 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-iptables-alerter-script\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092801 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysctl-d\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-cni-multus\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092337 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-cnibin\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092562 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-serviceca\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092865 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysconfig\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092891 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-kubernetes\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092914 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-lib-modules\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.092941 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092917 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6d5b666-4557-4d4f-a832-ba629e3d3496-hosts-file\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092957 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6d5b666-4557-4d4f-a832-ba629e3d3496-hosts-file\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87p6c\" (UniqueName: \"kubernetes.io/projected/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-kube-api-access-87p6c\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092984 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-system-cni-dir\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093003 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhnq\" (UniqueName: \"kubernetes.io/projected/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-kube-api-access-rfhnq\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093057 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-system-cni-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-k8s-cni-cncf-io\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d5b666-4557-4d4f-a832-ba629e3d3496-tmp-dir\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093189 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-os-release\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093221 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093258 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-sys\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-socket-dir-parent\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-etc-kubernetes\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-host\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-cni-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-daemon-config\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.093599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093422 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysctl-conf\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-host-slash\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.092469 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cnibin\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093467 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-modprobe-d\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-systemd\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093504 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-sysconfig\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s56g\" (UniqueName: \"kubernetes.io/projected/d25b940b-1f11-4a80-97d4-25b616df01c5-kube-api-access-7s56g\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093574 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-k8s-cni-cncf-io\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093608 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-netns\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093660 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-host\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-tuned\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093730 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-cni-binary-copy\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093731 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-host-slash\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-conf-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093804 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-system-cni-dir\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.094401 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093850 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-conf-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093870 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-socket-dir-parent\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093895 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-kubernetes\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093942 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-etc-kubernetes\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093983 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-host\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093983 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-cni-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094056 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-systemd\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094135 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-modprobe-d\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094333 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-os-release\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094377 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6d5b666-4557-4d4f-a832-ba629e3d3496-tmp-dir\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-host\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094638 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-multus-daemon-config\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.093502 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-system-cni-dir\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094701 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-run-netns\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094923 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.094990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-host-var-lib-cni-multus\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.095189 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.095262 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.095257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d25b940b-1f11-4a80-97d4-25b616df01c5-sys\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.096087 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.095531 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-cni-binary-copy\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.096087 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.096037 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d25b940b-1f11-4a80-97d4-25b616df01c5-tmp\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.097209 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.097168 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d25b940b-1f11-4a80-97d4-25b616df01c5-etc-tuned\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.106517 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.106460 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snvg4\" (UniqueName: \"kubernetes.io/projected/dbb5603a-6e72-4433-b26c-8d6e4a2fec12-kube-api-access-snvg4\") pod \"node-ca-f58nz\" (UID: \"dbb5603a-6e72-4433-b26c-8d6e4a2fec12\") " pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:03.108556 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.108532 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdkmb\" (UniqueName: \"kubernetes.io/projected/a6d5b666-4557-4d4f-a832-ba629e3d3496-kube-api-access-kdkmb\") pod \"node-resolver-9sqfs\" (UID: \"a6d5b666-4557-4d4f-a832-ba629e3d3496\") " pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:03.108850 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.108832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhnq\" (UniqueName: \"kubernetes.io/projected/61a2caa5-a22c-4684-b0e6-c2c5eea956c5-kube-api-access-rfhnq\") pod \"multus-additional-cni-plugins-v5xxj\" (UID: \"61a2caa5-a22c-4684-b0e6-c2c5eea956c5\") " pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.109524 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.109184 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87p6c\" (UniqueName: \"kubernetes.io/projected/ccf3ebee-64b3-4301-89ce-1b4786aeb58e-kube-api-access-87p6c\") pod \"multus-t7jcb\" (UID: \"ccf3ebee-64b3-4301-89ce-1b4786aeb58e\") " pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.110607 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.110114 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wnj7\" (UniqueName: \"kubernetes.io/projected/9e32da34-50f9-4711-b24f-dfe49fe7d2a1-kube-api-access-5wnj7\") pod \"iptables-alerter-ff4kz\" (UID: \"9e32da34-50f9-4711-b24f-dfe49fe7d2a1\") " pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:03.110852 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.110830 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s56g\" (UniqueName: \"kubernetes.io/projected/d25b940b-1f11-4a80-97d4-25b616df01c5-kube-api-access-7s56g\") pod \"tuned-zhl62\" (UID: \"d25b940b-1f11-4a80-97d4-25b616df01c5\") " pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.117832 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.117810 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:03.117832 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.117833 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:03.118008 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.117848 2556 projected.go:196] Error preparing data for projected volume kube-api-access-j67q5 for pod openshift-network-diagnostics/network-check-target-px7qh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:03.118008 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.117931 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5 podName:ddde3482-fd39-4276-96f9-68124e138c9d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:03.617909381 +0000 UTC m=+3.143673042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j67q5" (UniqueName: "kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5") pod "network-check-target-px7qh" (UID: "ddde3482-fd39-4276-96f9-68124e138c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:03.188550 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.188518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" Jul 18 00:55:03.198225 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.198198 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:03.199136 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:03.199089 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce9c81d_7910_46eb_a9cd_553091418db6.slice/crio-3685888b9b1e8dfd882e95fa87f1d9e42c875b976c0d3f8a5e0a719ce686c0d7 WatchSource:0}: Error finding container 3685888b9b1e8dfd882e95fa87f1d9e42c875b976c0d3f8a5e0a719ce686c0d7: Status 404 returned error can't find the container with id 3685888b9b1e8dfd882e95fa87f1d9e42c875b976c0d3f8a5e0a719ce686c0d7 Jul 18 00:55:03.211045 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.211009 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:03.212997 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.212978 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 18 00:55:03.216798 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.216778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" Jul 18 00:55:03.225674 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.225655 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f58nz" Jul 18 00:55:03.232329 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.232310 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zhl62" Jul 18 00:55:03.243849 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.243828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ff4kz" Jul 18 00:55:03.250846 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.250826 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t7jcb" Jul 18 00:55:03.262461 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.262435 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9sqfs" Jul 18 00:55:03.497892 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.497807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:03.498052 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.497893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:03.498052 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.497977 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:03.498052 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.497994 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:03.498052 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.498049 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs podName:f01ef9a9-c90f-4009-8ae4-1c6dc5691867 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:04.498031765 +0000 UTC m=+4.023795419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs") pod "network-metrics-daemon-9fhcl" (UID: "f01ef9a9-c90f-4009-8ae4-1c6dc5691867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:03.498206 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.498068 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret podName:22ca3617-ae2d-49ea-a5e8-42287275a957 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:04.49805904 +0000 UTC m=+4.023822694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret") pod "global-pull-secret-syncer-6xngz" (UID: "22ca3617-ae2d-49ea-a5e8-42287275a957") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:03.699686 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.699653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:03.699840 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.699818 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:03.699840 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.699837 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:03.699941 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.699852 2556 projected.go:196] Error preparing data for projected volume kube-api-access-j67q5 for pod openshift-network-diagnostics/network-check-target-px7qh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:03.699941 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:03.699918 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5 podName:ddde3482-fd39-4276-96f9-68124e138c9d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:04.699901716 +0000 UTC m=+4.225665389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j67q5" (UniqueName: "kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5") pod "network-check-target-px7qh" (UID: "ddde3482-fd39-4276-96f9-68124e138c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:03.922514 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.922461 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:50:02 +0000 UTC" deadline="2027-12-14 09:24:27.011413081 +0000 UTC" Jul 18 00:55:03.922514 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:03.922508 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12344h29m23.088908421s" Jul 18 00:55:04.008703 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:04.008670 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:04.008880 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.008785 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:04.018088 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:04.018055 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" event={"ID":"cce9c81d-7910-46eb-a9cd-553091418db6","Type":"ContainerStarted","Data":"3685888b9b1e8dfd882e95fa87f1d9e42c875b976c0d3f8a5e0a719ce686c0d7"} Jul 18 00:55:04.229563 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:04.229528 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a5f891a_1db5_40be_b4f8_e261cadbe47f.slice/crio-6354b094e0a1b984395d0151807f063419377d66305b8e83b1116374c40a5736 WatchSource:0}: Error finding container 6354b094e0a1b984395d0151807f063419377d66305b8e83b1116374c40a5736: Status 404 returned error can't find the container with id 6354b094e0a1b984395d0151807f063419377d66305b8e83b1116374c40a5736 Jul 18 00:55:04.245950 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:04.245912 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e32da34_50f9_4711_b24f_dfe49fe7d2a1.slice/crio-97bfe07e554ec19bde0cee3f3e93efe0a733f1870b447f1be74bd2ea59fa17aa WatchSource:0}: Error finding container 97bfe07e554ec19bde0cee3f3e93efe0a733f1870b447f1be74bd2ea59fa17aa: Status 404 returned error can't find the container with id 97bfe07e554ec19bde0cee3f3e93efe0a733f1870b447f1be74bd2ea59fa17aa Jul 18 00:55:04.248436 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:04.248416 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25b940b_1f11_4a80_97d4_25b616df01c5.slice/crio-449e1c98d92d02ec72f1eea8f202be52a2c42457f0a14ba8c900965c8ae2e097 WatchSource:0}: Error finding container 449e1c98d92d02ec72f1eea8f202be52a2c42457f0a14ba8c900965c8ae2e097: Status 404 returned error can't find the container with id 449e1c98d92d02ec72f1eea8f202be52a2c42457f0a14ba8c900965c8ae2e097 Jul 18 00:55:04.249668 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:04.249643 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf3ebee_64b3_4301_89ce_1b4786aeb58e.slice/crio-826897c71506624da7ef74427b084904a418859bbae290fc0e31af60f3b9109d WatchSource:0}: Error finding container 826897c71506624da7ef74427b084904a418859bbae290fc0e31af60f3b9109d: Status 404 returned error can't find the container with id 826897c71506624da7ef74427b084904a418859bbae290fc0e31af60f3b9109d Jul 18 00:55:04.251605 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:04.251254 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a2caa5_a22c_4684_b0e6_c2c5eea956c5.slice/crio-2a3f99caa3677943f46b73d1241687ca8787a29efc5a4543cfc7aa9142c1a427 WatchSource:0}: Error finding container 2a3f99caa3677943f46b73d1241687ca8787a29efc5a4543cfc7aa9142c1a427: Status 404 returned error can't find the container with id 2a3f99caa3677943f46b73d1241687ca8787a29efc5a4543cfc7aa9142c1a427 Jul 18 00:55:04.252276 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:04.252219 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb5603a_6e72_4433_b26c_8d6e4a2fec12.slice/crio-485847695e4f99dc2a20cb77cfd45f12dbc36fb18e09d009a169338e7c3ae314 WatchSource:0}: Error finding container 485847695e4f99dc2a20cb77cfd45f12dbc36fb18e09d009a169338e7c3ae314: Status 404 returned error can't find the container with id 485847695e4f99dc2a20cb77cfd45f12dbc36fb18e09d009a169338e7c3ae314 Jul 18 00:55:04.506339 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:04.506149 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:04.506523 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.506294 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:04.506523 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.506474 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs podName:f01ef9a9-c90f-4009-8ae4-1c6dc5691867 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:06.506452407 +0000 UTC m=+6.032216061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs") pod "network-metrics-daemon-9fhcl" (UID: "f01ef9a9-c90f-4009-8ae4-1c6dc5691867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:04.506523 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.506478 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:04.506688 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.506537 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret podName:22ca3617-ae2d-49ea-a5e8-42287275a957 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:06.506513615 +0000 UTC m=+6.032277272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret") pod "global-pull-secret-syncer-6xngz" (UID: "22ca3617-ae2d-49ea-a5e8-42287275a957") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:04.506688 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:04.506405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:04.708792 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:04.708754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:04.708993 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.708966 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:04.708993 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.708990 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:04.709195 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.709003 2556 projected.go:196] Error preparing data for projected volume kube-api-access-j67q5 for pod openshift-network-diagnostics/network-check-target-px7qh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:04.709195 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:04.709098 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5 podName:ddde3482-fd39-4276-96f9-68124e138c9d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:06.709077673 +0000 UTC m=+6.234841337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j67q5" (UniqueName: "kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5") pod "network-check-target-px7qh" (UID: "ddde3482-fd39-4276-96f9-68124e138c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:04.923935 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:04.923852 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 00:50:02 +0000 UTC" deadline="2028-02-17 20:41:01.159359385 +0000 UTC" Jul 18 00:55:04.923935 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:04.923893 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13915h45m56.235471083s" Jul 18 00:55:05.011408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.011375 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:05.011579 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:05.011516 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:05.011944 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.011921 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:05.012083 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:05.012060 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:05.026780 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.026738 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t7jcb" event={"ID":"ccf3ebee-64b3-4301-89ce-1b4786aeb58e","Type":"ContainerStarted","Data":"826897c71506624da7ef74427b084904a418859bbae290fc0e31af60f3b9109d"} Jul 18 00:55:05.029171 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.028778 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8qlp" event={"ID":"387b636d-e2b9-4dec-a8be-c03e24d54dfa","Type":"ContainerStarted","Data":"c4bc863795cee72d2b7f8dbc5c71e827f2a4ff9e00e425f171d5386b4f11df7b"} Jul 18 00:55:05.032616 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.032584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f58nz" event={"ID":"dbb5603a-6e72-4433-b26c-8d6e4a2fec12","Type":"ContainerStarted","Data":"485847695e4f99dc2a20cb77cfd45f12dbc36fb18e09d009a169338e7c3ae314"} Jul 18 00:55:05.041838 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.041807 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhl62" event={"ID":"d25b940b-1f11-4a80-97d4-25b616df01c5","Type":"ContainerStarted","Data":"449e1c98d92d02ec72f1eea8f202be52a2c42457f0a14ba8c900965c8ae2e097"} Jul 18 00:55:05.045115 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.045041 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerStarted","Data":"2a3f99caa3677943f46b73d1241687ca8787a29efc5a4543cfc7aa9142c1a427"} Jul 18 00:55:05.051599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.051320 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ff4kz" event={"ID":"9e32da34-50f9-4711-b24f-dfe49fe7d2a1","Type":"ContainerStarted","Data":"97bfe07e554ec19bde0cee3f3e93efe0a733f1870b447f1be74bd2ea59fa17aa"} Jul 18 00:55:05.060626 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.060592 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"6354b094e0a1b984395d0151807f063419377d66305b8e83b1116374c40a5736"} Jul 18 00:55:05.066655 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.066626 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" event={"ID":"ded9cd7b6d6d15858bf2deecb597081d","Type":"ContainerStarted","Data":"8d1e51107fe263188096cb71624bed760bdc3f7a381d48e0d67810ba7a3a8d42"} Jul 18 00:55:05.080821 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.080787 2556 generic.go:356] "Generic (PLEG): container finished" podID="7f3eb8112d8d583103163638d540f440" containerID="43b57e2e8e7c749d54e4db4db6e1c7763bbc46d254f88cbd19ec0abca33b8697" exitCode=0 Jul 18 00:55:05.080952 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.080873 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" event={"ID":"7f3eb8112d8d583103163638d540f440","Type":"ContainerDied","Data":"43b57e2e8e7c749d54e4db4db6e1c7763bbc46d254f88cbd19ec0abca33b8697"} Jul 18 00:55:05.093056 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.092980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9sqfs" event={"ID":"a6d5b666-4557-4d4f-a832-ba629e3d3496","Type":"ContainerStarted","Data":"31b945448f9c2fbc6555168747c2c53f970941405ab32b2a0f94e6817816cad9"} Jul 18 00:55:05.106887 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:05.106827 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-101.ec2.internal" podStartSLOduration=3.106807215 podStartE2EDuration="3.106807215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:05.083878368 +0000 UTC m=+4.609642044" watchObservedRunningTime="2026-07-18 00:55:05.106807215 +0000 UTC m=+4.632570891" Jul 18 00:55:06.008788 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:06.008758 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:06.009310 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.008884 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:06.137196 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:06.137161 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" event={"ID":"7f3eb8112d8d583103163638d540f440","Type":"ContainerStarted","Data":"702887dc98f8f06e01813a18adc875322332d6704d48b0f12aa2174f2cea4819"} Jul 18 00:55:06.523452 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:06.523415 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:06.523671 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:06.523490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:06.523671 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.523638 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:06.523783 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.523699 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs podName:f01ef9a9-c90f-4009-8ae4-1c6dc5691867 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:10.523680869 +0000 UTC m=+10.049444526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs") pod "network-metrics-daemon-9fhcl" (UID: "f01ef9a9-c90f-4009-8ae4-1c6dc5691867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:06.524135 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.524113 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:06.524235 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.524167 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret podName:22ca3617-ae2d-49ea-a5e8-42287275a957 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:10.524153189 +0000 UTC m=+10.049916855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret") pod "global-pull-secret-syncer-6xngz" (UID: "22ca3617-ae2d-49ea-a5e8-42287275a957") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:06.724845 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:06.724801 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:06.725041 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.724985 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:06.725041 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.725008 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:06.725169 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.725038 2556 projected.go:196] Error preparing data for projected volume kube-api-access-j67q5 for pod openshift-network-diagnostics/network-check-target-px7qh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:06.725169 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:06.725121 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5 podName:ddde3482-fd39-4276-96f9-68124e138c9d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:10.725098649 +0000 UTC m=+10.250862313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j67q5" (UniqueName: "kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5") pod "network-check-target-px7qh" (UID: "ddde3482-fd39-4276-96f9-68124e138c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:07.010899 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:07.010818 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:07.011383 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:07.010954 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:07.011383 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:07.011354 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:07.011518 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:07.011453 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:08.008827 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:08.008791 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:08.009033 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:08.008918 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:09.008138 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:09.008107 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:09.008138 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:09.008144 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:09.008647 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:09.008264 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:09.008647 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:09.008565 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:10.008297 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:10.008251 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:10.008665 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.008392 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:10.555396 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:10.555328 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:10.555396 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:10.555401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:10.555656 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.555566 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:10.555656 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.555631 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs podName:f01ef9a9-c90f-4009-8ae4-1c6dc5691867 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:18.555610905 +0000 UTC m=+18.081374568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs") pod "network-metrics-daemon-9fhcl" (UID: "f01ef9a9-c90f-4009-8ae4-1c6dc5691867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:10.556055 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.556036 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:10.556158 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.556087 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret podName:22ca3617-ae2d-49ea-a5e8-42287275a957 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:18.5560725 +0000 UTC m=+18.081836156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret") pod "global-pull-secret-syncer-6xngz" (UID: "22ca3617-ae2d-49ea-a5e8-42287275a957") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:10.757674 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:10.757636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:10.757855 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.757793 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:10.757855 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.757817 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:10.757855 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.757828 2556 projected.go:196] Error preparing data for projected volume kube-api-access-j67q5 for pod openshift-network-diagnostics/network-check-target-px7qh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:10.757998 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:10.757886 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5 podName:ddde3482-fd39-4276-96f9-68124e138c9d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:18.757867995 +0000 UTC m=+18.283631652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j67q5" (UniqueName: "kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5") pod "network-check-target-px7qh" (UID: "ddde3482-fd39-4276-96f9-68124e138c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:11.009210 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:11.009133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:11.009656 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:11.009267 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:11.009656 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:11.009275 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:11.010334 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:11.010297 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:12.008633 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:12.008596 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:12.008801 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:12.008733 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:13.010051 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:13.009149 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:13.010051 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:13.009192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:13.010051 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:13.009389 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:13.010051 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:13.009536 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:14.008225 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:14.008192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:14.008409 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:14.008324 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:15.008294 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:15.008210 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:15.008294 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:15.008212 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:15.008725 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:15.008365 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:15.008725 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:15.008456 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:16.008182 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:16.008150 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:16.008348 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:16.008259 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:17.008570 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:17.008537 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:17.008963 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:17.008670 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:17.008963 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:17.008708 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:17.008963 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:17.008770 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:18.008774 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:18.008732 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:18.009322 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.008905 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:18.618162 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:18.618112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:18.618366 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:18.618190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:18.618366 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.618289 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:18.618366 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.618310 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:18.618366 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.618361 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs podName:f01ef9a9-c90f-4009-8ae4-1c6dc5691867 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:34.618342332 +0000 UTC m=+34.144105985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs") pod "network-metrics-daemon-9fhcl" (UID: "f01ef9a9-c90f-4009-8ae4-1c6dc5691867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:18.618624 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.618381 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret podName:22ca3617-ae2d-49ea-a5e8-42287275a957 nodeName:}" failed. No retries permitted until 2026-07-18 00:55:34.618370914 +0000 UTC m=+34.144134567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret") pod "global-pull-secret-syncer-6xngz" (UID: "22ca3617-ae2d-49ea-a5e8-42287275a957") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:18.820541 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:18.820447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:18.820712 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.820628 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:18.820712 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.820652 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:18.820712 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.820665 2556 projected.go:196] Error preparing data for projected volume kube-api-access-j67q5 for pod openshift-network-diagnostics/network-check-target-px7qh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:18.820872 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:18.820726 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5 podName:ddde3482-fd39-4276-96f9-68124e138c9d nodeName:}" failed. No retries permitted until 2026-07-18 00:55:34.820707539 +0000 UTC m=+34.346471214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j67q5" (UniqueName: "kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5") pod "network-check-target-px7qh" (UID: "ddde3482-fd39-4276-96f9-68124e138c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:19.008568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:19.008532 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:19.008755 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:19.008587 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:19.008755 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:19.008700 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:19.009183 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:19.008848 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:20.008862 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:20.008822 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:20.009357 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:20.008961 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:21.011986 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:21.011553 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:21.011986 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:21.011669 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:21.011986 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:21.011737 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:21.011986 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:21.011841 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:22.008278 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:22.008229 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:22.008483 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:22.008372 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:23.008094 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:23.008057 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:23.008094 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:23.008095 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:23.008513 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:23.008180 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:23.008513 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:23.008310 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:23.192090 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:23.191998 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w8qlp" event={"ID":"387b636d-e2b9-4dec-a8be-c03e24d54dfa","Type":"ContainerStarted","Data":"5c85cc50c3c0386e25f9bc078719556d97413fe5415e3946b64c2166f0d64cfc"} Jul 18 00:55:23.210202 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:23.209100 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-101.ec2.internal" podStartSLOduration=21.209081032 podStartE2EDuration="21.209081032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:06.16393495 +0000 UTC m=+5.689698625" watchObservedRunningTime="2026-07-18 00:55:23.209081032 +0000 UTC m=+22.734844708" Jul 18 00:55:23.210202 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:23.209674 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w8qlp" podStartSLOduration=3.452464979 podStartE2EDuration="22.209657604s" totalImagesPullingTime="18.757192625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:23.208770779 +0000 UTC m=+22.734534455" watchObservedRunningTime="2026-07-18 00:55:23.209657604 +0000 UTC m=+22.735421281" Jul 18 00:55:24.008228 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.007940 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:24.008882 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:24.008325 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:24.010710 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.010678 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 18 00:55:24.196458 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.196425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" event={"ID":"cce9c81d-7910-46eb-a9cd-553091418db6","Type":"ContainerStarted","Data":"c00d74cca6e3111f50279af36805e2cd40ea792bd51ec5860d7790953fa2e03c"} Jul 18 00:55:24.196613 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.196485 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" event={"ID":"cce9c81d-7910-46eb-a9cd-553091418db6","Type":"ContainerStarted","Data":"2558a6b650a5fbda89bcb057edc101266aa56ca8dca25ff64eb766dec5eb0f9f"} Jul 18 00:55:24.197898 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.197872 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t7jcb" event={"ID":"ccf3ebee-64b3-4301-89ce-1b4786aeb58e","Type":"ContainerStarted","Data":"621d3e619d807de88c1862156b850db1302ba018eb75f6518c32845a5fc9cf9b"} Jul 18 00:55:24.199324 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.199301 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f58nz" event={"ID":"dbb5603a-6e72-4433-b26c-8d6e4a2fec12","Type":"ContainerStarted","Data":"2c13b9cfab48a306daaf43f6ad78d678c37b974cf6a1965d8fde245b8832f1da"} Jul 18 00:55:24.200608 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.200585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zhl62" event={"ID":"d25b940b-1f11-4a80-97d4-25b616df01c5","Type":"ContainerStarted","Data":"5b85f6cbfb080cb611bde02069f96e3cf5e78f0cf079adbadbdaac6602ec9eee"} Jul 18 00:55:24.202153 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.202132 2556 generic.go:356] "Generic (PLEG): container finished" podID="61a2caa5-a22c-4684-b0e6-c2c5eea956c5" containerID="2c8b8f16f98e13795fb8247fb54561f24e1bb9e318351dc9caafbdafab5d62a1" exitCode=0 Jul 18 00:55:24.202252 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.202211 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerDied","Data":"2c8b8f16f98e13795fb8247fb54561f24e1bb9e318351dc9caafbdafab5d62a1"} Jul 18 00:55:24.205123 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.205094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"b6f41c31e65289fe33b25c95c76147bb21e0a0239b30696e0b49a2017d2fbcaf"} Jul 18 00:55:24.205210 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.205164 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"6eeb23a4902dbd7212b9caf4cbc744eda5135d8758582f8636d56b4bc320c002"} Jul 18 00:55:24.205210 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.205204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"02eb9382fe9f3356b0ff6a25539994c936a4e8a64a19563bff94dfc853f9c9b7"} Jul 18 00:55:24.205305 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.205248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"db8d39aea446a246be70794651f0728add567142a350486a7739f41820ae0a7f"} Jul 18 00:55:24.205305 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.205277 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"b47b976acebf54bd28248679aa0f72751f76cf5238683a5d9e756ac1e523954c"} Jul 18 00:55:24.205387 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.205311 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"5698b051b6d5576d661e118180038a4913c76b4c4901a0a460f92fea228c3262"} Jul 18 00:55:24.206310 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.206292 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9sqfs" event={"ID":"a6d5b666-4557-4d4f-a832-ba629e3d3496","Type":"ContainerStarted","Data":"8f1ff2f6b6c1dfd3adf26c0776ff60c22f2e0630934ffecf6b7ee087ee37ed8a"} Jul 18 00:55:24.216706 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.216663 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t7jcb" podStartSLOduration=4.446061051 podStartE2EDuration="23.216649007s" totalImagesPullingTime="18.770587956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:24.21598148 +0000 UTC m=+23.741745344" watchObservedRunningTime="2026-07-18 00:55:24.216649007 +0000 UTC m=+23.742412681" Jul 18 00:55:24.250528 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.250470 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f58nz" podStartSLOduration=4.523751723 podStartE2EDuration="23.25045592s" totalImagesPullingTime="18.726704197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:24.249980159 +0000 UTC m=+23.775743834" watchObservedRunningTime="2026-07-18 00:55:24.25045592 +0000 UTC m=+23.776219595" Jul 18 00:55:24.269037 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.267821 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9sqfs" podStartSLOduration=4.500269795 podStartE2EDuration="23.267802217s" totalImagesPullingTime="18.767532422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:24.266839521 +0000 UTC m=+23.792603197" watchObservedRunningTime="2026-07-18 00:55:24.267802217 +0000 UTC m=+23.793565892" Jul 18 00:55:24.284947 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.284897 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zhl62" podStartSLOduration=4.520889353 podStartE2EDuration="23.284882255s" totalImagesPullingTime="18.763992902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:24.284731913 +0000 UTC m=+23.810495587" watchObservedRunningTime="2026-07-18 00:55:24.284882255 +0000 UTC m=+23.810645950" Jul 18 00:55:24.946856 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.946745 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T00:55:24.010696384Z","UUID":"3184a9d1-d905-4315-a7ba-a985a1cbd5f2","Handler":null,"Name":"","Endpoint":""} Jul 18 00:55:24.948402 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.948382 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 18 00:55:24.948520 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:24.948422 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 18 00:55:25.008792 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:25.008765 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:25.008792 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:25.008792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:25.009380 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:25.008894 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:25.009380 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:25.009047 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:25.210678 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:25.210588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" event={"ID":"cce9c81d-7910-46eb-a9cd-553091418db6","Type":"ContainerStarted","Data":"7ae3bb3878642fe9491f64515813efa38b7f2d38c4274fc711f4e8e74e83efd0"} Jul 18 00:55:25.212256 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:25.212225 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ff4kz" event={"ID":"9e32da34-50f9-4711-b24f-dfe49fe7d2a1","Type":"ContainerStarted","Data":"d44d45dec6b1eaaa9ecadbff68514958e3e0e870be819e893a1848649ac8f545"} Jul 18 00:55:25.232130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:25.232085 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jrh5r" podStartSLOduration=2.8731632879999998 podStartE2EDuration="24.232066284s" totalImagesPullingTime="21.358902996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:25.231716918 +0000 UTC m=+24.757480584" watchObservedRunningTime="2026-07-18 00:55:25.232066284 +0000 UTC m=+24.757829960" Jul 18 00:55:25.246484 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:25.246423 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ff4kz" podStartSLOduration=5.481435634 podStartE2EDuration="24.246404575s" totalImagesPullingTime="18.764968941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:25.245722774 +0000 UTC m=+24.771486450" watchObservedRunningTime="2026-07-18 00:55:25.246404575 +0000 UTC m=+24.772168254" Jul 18 00:55:26.008383 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:26.008308 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:26.008515 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:26.008413 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:26.218582 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:26.218536 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"0f2073813f8454bf22103b404b88f5f28d143c233aca181d4fd884b7db5c177f"} Jul 18 00:55:26.941812 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:26.941745 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:26.942368 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:26.942347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:27.008302 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:27.008271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:27.008471 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:27.008417 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:27.008512 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:27.008469 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:27.008585 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:27.008565 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:27.220947 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:27.220868 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:27.221438 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:27.221417 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w8qlp" Jul 18 00:55:28.008336 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:28.008090 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:28.008478 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:28.008395 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:29.008699 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:29.008628 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:29.009103 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:29.008627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:29.009103 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:29.008740 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:29.009103 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:29.008822 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:29.229486 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:29.229449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" event={"ID":"5a5f891a-1db5-40be-b4f8-e261cadbe47f","Type":"ContainerStarted","Data":"1e877d313c37dd36bda31c04dc5c2a3060c943bae699d056fb03bdadc9effd68"} Jul 18 00:55:29.264907 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:29.264801 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" podStartSLOduration=9.430439205 podStartE2EDuration="28.264784542s" totalImagesPullingTime="18.834345337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:29.263530513 +0000 UTC m=+28.789294212" watchObservedRunningTime="2026-07-18 00:55:29.264784542 +0000 UTC m=+28.790548217" Jul 18 00:55:30.008826 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.008586 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:30.009474 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:30.008851 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:30.233417 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.233381 2556 generic.go:356] "Generic (PLEG): container finished" podID="61a2caa5-a22c-4684-b0e6-c2c5eea956c5" containerID="e605077c420082da69e1943c55bae68954338fc4e6d5fa8ec330c7a567f580cd" exitCode=0 Jul 18 00:55:30.233577 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.233463 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerDied","Data":"e605077c420082da69e1943c55bae68954338fc4e6d5fa8ec330c7a567f580cd"} Jul 18 00:55:30.233928 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.233909 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:30.233989 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.233973 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:30.234056 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.234045 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:30.249904 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.249879 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:30.250042 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:30.249988 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:55:31.009109 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:31.009082 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:31.009458 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:31.009174 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:31.009458 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:31.009222 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:31.009458 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:31.009338 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:32.008358 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:32.008279 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:32.008494 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:32.008386 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:32.239363 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:32.239328 2556 generic.go:356] "Generic (PLEG): container finished" podID="61a2caa5-a22c-4684-b0e6-c2c5eea956c5" containerID="75e5ed66a1b70da326a78f0f018bba031f3a48734709d39be9184a05d704be4d" exitCode=0 Jul 18 00:55:32.239802 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:32.239411 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerDied","Data":"75e5ed66a1b70da326a78f0f018bba031f3a48734709d39be9184a05d704be4d"} Jul 18 00:55:33.008848 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:33.008811 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:33.008848 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:33.008831 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:33.009073 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:33.008933 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:33.009135 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:33.009080 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:34.008584 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:34.008547 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:34.008985 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.008652 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:34.249422 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:34.249391 2556 generic.go:356] "Generic (PLEG): container finished" podID="61a2caa5-a22c-4684-b0e6-c2c5eea956c5" containerID="ca47535de6d4680a8077adc68a98683902f67cca1bd7c0d71565ed88801a95dc" exitCode=0 Jul 18 00:55:34.249581 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:34.249436 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerDied","Data":"ca47535de6d4680a8077adc68a98683902f67cca1bd7c0d71565ed88801a95dc"} Jul 18 00:55:34.641156 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:34.641120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:34.641309 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:34.641167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:34.641309 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.641267 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:34.641309 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.641268 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:34.641425 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.641320 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs podName:f01ef9a9-c90f-4009-8ae4-1c6dc5691867 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:06.641305285 +0000 UTC m=+66.167068941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs") pod "network-metrics-daemon-9fhcl" (UID: "f01ef9a9-c90f-4009-8ae4-1c6dc5691867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 18 00:55:34.641425 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.641332 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret podName:22ca3617-ae2d-49ea-a5e8-42287275a957 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:06.641326229 +0000 UTC m=+66.167089882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret") pod "global-pull-secret-syncer-6xngz" (UID: "22ca3617-ae2d-49ea-a5e8-42287275a957") : object "kube-system"/"original-pull-secret" not registered Jul 18 00:55:34.842222 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:34.842178 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:34.842373 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.842344 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 18 00:55:34.842373 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.842364 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 18 00:55:34.842463 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.842379 2556 projected.go:196] Error preparing data for projected volume kube-api-access-j67q5 for pod openshift-network-diagnostics/network-check-target-px7qh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:34.842463 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:34.842435 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5 podName:ddde3482-fd39-4276-96f9-68124e138c9d nodeName:}" failed. No retries permitted until 2026-07-18 00:56:06.842417267 +0000 UTC m=+66.368180923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j67q5" (UniqueName: "kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5") pod "network-check-target-px7qh" (UID: "ddde3482-fd39-4276-96f9-68124e138c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 18 00:55:35.008970 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:35.008889 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:35.009389 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:35.009034 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:35.009389 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:35.009074 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:35.009389 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:35.009200 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:36.008429 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:36.008403 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:36.008619 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:36.008501 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:37.009652 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:37.007879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:37.009652 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:37.008008 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:37.009652 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:37.008097 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:37.009652 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:37.008199 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:38.008778 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:38.008741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:38.008945 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:38.008855 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:39.008426 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:39.008397 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:39.008885 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:39.008520 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:39.008885 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:39.008590 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:39.008885 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:39.008719 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:39.262593 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:39.262518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerStarted","Data":"4fbee0fb2b62aa1fcb7d382913c82957d27b31e40c9c0c31434a16be85ab2b08"} Jul 18 00:55:40.007815 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:40.007775 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:40.008091 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:40.007874 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:40.267420 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:40.267341 2556 generic.go:356] "Generic (PLEG): container finished" podID="61a2caa5-a22c-4684-b0e6-c2c5eea956c5" containerID="4fbee0fb2b62aa1fcb7d382913c82957d27b31e40c9c0c31434a16be85ab2b08" exitCode=0 Jul 18 00:55:40.267902 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:40.267424 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerDied","Data":"4fbee0fb2b62aa1fcb7d382913c82957d27b31e40c9c0c31434a16be85ab2b08"} Jul 18 00:55:41.009226 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:41.009193 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:41.009391 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:41.009285 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:41.009391 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:41.009337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:41.009460 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:41.009426 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:41.272641 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:41.272560 2556 generic.go:356] "Generic (PLEG): container finished" podID="61a2caa5-a22c-4684-b0e6-c2c5eea956c5" containerID="5c26b0955bffe993297b187e35ac85f3b0f1c0d0544b8f3fc3e6dea3ba5a38a6" exitCode=0 Jul 18 00:55:41.272641 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:41.272614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerDied","Data":"5c26b0955bffe993297b187e35ac85f3b0f1c0d0544b8f3fc3e6dea3ba5a38a6"} Jul 18 00:55:42.008273 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:42.008244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:42.008443 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:42.008339 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:42.277746 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:42.277666 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" event={"ID":"61a2caa5-a22c-4684-b0e6-c2c5eea956c5","Type":"ContainerStarted","Data":"f5ea9aee4a98bc5e6f83da963352aff556ce3d1c7d8c73b5bc589a2cbfe5bc07"} Jul 18 00:55:42.299581 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:42.299528 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v5xxj" podStartSLOduration=10.088773689 podStartE2EDuration="41.299512969s" totalImagesPullingTime="31.21073928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:42.298361108 +0000 UTC m=+41.824124782" watchObservedRunningTime="2026-07-18 00:55:42.299512969 +0000 UTC m=+41.825276644" Jul 18 00:55:43.008708 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:43.008682 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:43.008875 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:43.008779 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:43.008875 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:43.008863 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:43.009000 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:43.008978 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:44.008474 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:44.008438 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:44.008853 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:44.008543 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:45.008536 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.008365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:45.008982 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.008365 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:45.008982 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:45.008630 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:45.008982 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:45.008679 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:45.072232 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.072204 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-px7qh"] Jul 18 00:55:45.072384 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.072302 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:45.072425 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:45.072385 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:45.074663 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.074619 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xngz"] Jul 18 00:55:45.075329 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.075305 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9fhcl"] Jul 18 00:55:45.284295 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.284271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:45.284480 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:45.284273 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:45.284480 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:45.284377 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:45.284480 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:45.284445 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:47.007932 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:47.007890 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:47.008511 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:47.007894 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:47.008511 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:47.007985 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6xngz" podUID="22ca3617-ae2d-49ea-a5e8-42287275a957" Jul 18 00:55:47.008511 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:47.008091 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9fhcl" podUID="f01ef9a9-c90f-4009-8ae4-1c6dc5691867" Jul 18 00:55:47.008511 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:47.008138 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:47.008511 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:47.008213 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-px7qh" podUID="ddde3482-fd39-4276-96f9-68124e138c9d" Jul 18 00:55:48.797872 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.797842 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-101.ec2.internal" event="NodeReady" Jul 18 00:55:48.798362 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.797978 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 18 00:55:48.830949 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.830914 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9"] Jul 18 00:55:48.833823 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.833780 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.836179 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.836159 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wzpgs\"" Jul 18 00:55:48.836282 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.836190 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 18 00:55:48.836282 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.836246 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 18 00:55:48.836282 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.836253 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 18 00:55:48.841553 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.841533 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 18 00:55:48.844853 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.844829 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bqwfv"] Jul 18 00:55:48.847718 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.847697 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:48.848538 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.848502 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9"] Jul 18 00:55:48.849205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.849185 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9z2bf"] Jul 18 00:55:48.850155 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.850134 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d2qsz\"" Jul 18 00:55:48.850240 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.850177 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 18 00:55:48.850240 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.850195 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 18 00:55:48.851858 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.851842 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:48.853837 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.853817 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 18 00:55:48.853962 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.853945 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gf4wb\"" Jul 18 00:55:48.854096 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.853971 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 18 00:55:48.854096 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.854065 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 18 00:55:48.858990 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.858955 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bqwfv"] Jul 18 00:55:48.862163 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.862140 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9z2bf"] Jul 18 00:55:48.945333 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945300 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa025570-afe5-4a85-8d35-960b77280485-cert\") pod \"ingress-canary-9z2bf\" (UID: \"aa025570-afe5-4a85-8d35-960b77280485\") " pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:48.945333 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jv6h\" (UniqueName: \"kubernetes.io/projected/aa025570-afe5-4a85-8d35-960b77280485-kube-api-access-4jv6h\") pod \"ingress-canary-9z2bf\" (UID: \"aa025570-afe5-4a85-8d35-960b77280485\") " pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8d57ad7-f36b-47b9-9e9b-837e2c852930-trusted-ca\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-bound-sa-token\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945421 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/429d665b-3f33-48ac-b759-29a4e3faac27-config-volume\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/429d665b-3f33-48ac-b759-29a4e3faac27-metrics-tls\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fb9q\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-kube-api-access-9fb9q\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945498 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8d57ad7-f36b-47b9-9e9b-837e2c852930-image-registry-private-configuration\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-registry-tls\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.945540 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945529 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8d57ad7-f36b-47b9-9e9b-837e2c852930-registry-certificates\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.945798 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8d57ad7-f36b-47b9-9e9b-837e2c852930-ca-trust-extracted\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:48.945798 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/429d665b-3f33-48ac-b759-29a4e3faac27-tmp-dir\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:48.945798 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945622 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4f2t\" (UniqueName: \"kubernetes.io/projected/429d665b-3f33-48ac-b759-29a4e3faac27-kube-api-access-q4f2t\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:48.945798 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:48.945652 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8d57ad7-f36b-47b9-9e9b-837e2c852930-installation-pull-secrets\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.008893 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.008844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:55:49.009095 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.008844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:55:49.009170 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.008844 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:55:49.011525 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.011504 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:55:49.011661 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.011566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d8vg\"" Jul 18 00:55:49.011661 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.011611 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:55:49.011661 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.011639 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4tv4\"" Jul 18 00:55:49.011815 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.011706 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:55:49.011957 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.011940 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:55:49.046699 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.046670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8d57ad7-f36b-47b9-9e9b-837e2c852930-installation-pull-secrets\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.046855 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.046712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa025570-afe5-4a85-8d35-960b77280485-cert\") pod \"ingress-canary-9z2bf\" (UID: \"aa025570-afe5-4a85-8d35-960b77280485\") " pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:49.046855 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.046732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jv6h\" (UniqueName: \"kubernetes.io/projected/aa025570-afe5-4a85-8d35-960b77280485-kube-api-access-4jv6h\") pod \"ingress-canary-9z2bf\" (UID: \"aa025570-afe5-4a85-8d35-960b77280485\") " pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:49.046855 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.046750 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8d57ad7-f36b-47b9-9e9b-837e2c852930-trusted-ca\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.046855 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.046778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-bound-sa-token\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.047736 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.047379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/429d665b-3f33-48ac-b759-29a4e3faac27-config-volume\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.047736 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.047432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/429d665b-3f33-48ac-b759-29a4e3faac27-metrics-tls\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.047736 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.047528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fb9q\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-kube-api-access-9fb9q\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.047736 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.047567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8d57ad7-f36b-47b9-9e9b-837e2c852930-image-registry-private-configuration\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.047736 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.047602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-registry-tls\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.047736 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.047637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8d57ad7-f36b-47b9-9e9b-837e2c852930-registry-certificates\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.048393 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.048304 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/429d665b-3f33-48ac-b759-29a4e3faac27-config-volume\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.048730 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.048679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8d57ad7-f36b-47b9-9e9b-837e2c852930-ca-trust-extracted\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.048842 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.048750 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/429d665b-3f33-48ac-b759-29a4e3faac27-tmp-dir\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.052094 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.048913 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4f2t\" (UniqueName: \"kubernetes.io/projected/429d665b-3f33-48ac-b759-29a4e3faac27-kube-api-access-q4f2t\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.052094 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.049378 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8d57ad7-f36b-47b9-9e9b-837e2c852930-trusted-ca\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.052094 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.049866 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/429d665b-3f33-48ac-b759-29a4e3faac27-tmp-dir\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.052094 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.050427 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8d57ad7-f36b-47b9-9e9b-837e2c852930-registry-certificates\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.052481 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.052461 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/429d665b-3f33-48ac-b759-29a4e3faac27-metrics-tls\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.052669 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.052647 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa025570-afe5-4a85-8d35-960b77280485-cert\") pod \"ingress-canary-9z2bf\" (UID: \"aa025570-afe5-4a85-8d35-960b77280485\") " pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:49.052833 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.052809 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8d57ad7-f36b-47b9-9e9b-837e2c852930-ca-trust-extracted\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.053118 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.053090 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8d57ad7-f36b-47b9-9e9b-837e2c852930-installation-pull-secrets\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.053212 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.053135 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-registry-tls\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.054481 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.054456 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8d57ad7-f36b-47b9-9e9b-837e2c852930-image-registry-private-configuration\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.056462 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.056442 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jv6h\" (UniqueName: \"kubernetes.io/projected/aa025570-afe5-4a85-8d35-960b77280485-kube-api-access-4jv6h\") pod \"ingress-canary-9z2bf\" (UID: \"aa025570-afe5-4a85-8d35-960b77280485\") " pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:49.056706 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.056686 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fb9q\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-kube-api-access-9fb9q\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.057053 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.057037 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8d57ad7-f36b-47b9-9e9b-837e2c852930-bound-sa-token\") pod \"image-registry-5fc4b8c4d9-hb6f9\" (UID: \"d8d57ad7-f36b-47b9-9e9b-837e2c852930\") " pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.057130 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.057112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4f2t\" (UniqueName: \"kubernetes.io/projected/429d665b-3f33-48ac-b759-29a4e3faac27-kube-api-access-q4f2t\") pod \"dns-default-bqwfv\" (UID: \"429d665b-3f33-48ac-b759-29a4e3faac27\") " pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.144112 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.144076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:49.157867 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.157843 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:49.163971 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.163944 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9z2bf" Jul 18 00:55:49.324623 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.324442 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bqwfv"] Jul 18 00:55:49.327528 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:49.327503 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429d665b_3f33_48ac_b759_29a4e3faac27.slice/crio-2e09d54760ee787dded569b5e7ddea95bd86d3631e24f5b9709bd3cf9edd7232 WatchSource:0}: Error finding container 2e09d54760ee787dded569b5e7ddea95bd86d3631e24f5b9709bd3cf9edd7232: Status 404 returned error can't find the container with id 2e09d54760ee787dded569b5e7ddea95bd86d3631e24f5b9709bd3cf9edd7232 Jul 18 00:55:49.331062 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.331036 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9"] Jul 18 00:55:49.333884 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:49.333859 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d57ad7_f36b_47b9_9e9b_837e2c852930.slice/crio-f43f3d89a4973373e49e96501a39c7c47739837ff86606aa3a98e61800cd5cfc WatchSource:0}: Error finding container f43f3d89a4973373e49e96501a39c7c47739837ff86606aa3a98e61800cd5cfc: Status 404 returned error can't find the container with id f43f3d89a4973373e49e96501a39c7c47739837ff86606aa3a98e61800cd5cfc Jul 18 00:55:49.338257 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:49.338236 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9z2bf"] Jul 18 00:55:49.342651 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:55:49.342628 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa025570_afe5_4a85_8d35_960b77280485.slice/crio-24dcaf634479d16d9d4d8064962266e88816e1c6af428e9b91e3dfbb2886a4c5 WatchSource:0}: Error finding container 24dcaf634479d16d9d4d8064962266e88816e1c6af428e9b91e3dfbb2886a4c5: Status 404 returned error can't find the container with id 24dcaf634479d16d9d4d8064962266e88816e1c6af428e9b91e3dfbb2886a4c5 Jul 18 00:55:50.298940 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:50.298898 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9z2bf" event={"ID":"aa025570-afe5-4a85-8d35-960b77280485","Type":"ContainerStarted","Data":"24dcaf634479d16d9d4d8064962266e88816e1c6af428e9b91e3dfbb2886a4c5"} Jul 18 00:55:50.300339 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:50.300310 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqwfv" event={"ID":"429d665b-3f33-48ac-b759-29a4e3faac27","Type":"ContainerStarted","Data":"2e09d54760ee787dded569b5e7ddea95bd86d3631e24f5b9709bd3cf9edd7232"} Jul 18 00:55:50.302757 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:50.301995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" event={"ID":"d8d57ad7-f36b-47b9-9e9b-837e2c852930","Type":"ContainerStarted","Data":"cfe06ff9ac07c4e1020c99ee5eb292654536be847bec038293f7b808954e1608"} Jul 18 00:55:50.302757 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:50.302054 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" event={"ID":"d8d57ad7-f36b-47b9-9e9b-837e2c852930","Type":"ContainerStarted","Data":"f43f3d89a4973373e49e96501a39c7c47739837ff86606aa3a98e61800cd5cfc"} Jul 18 00:55:50.302757 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:50.302706 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:55:53.310191 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:53.309922 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9z2bf" event={"ID":"aa025570-afe5-4a85-8d35-960b77280485","Type":"ContainerStarted","Data":"f2f97e0eea44800515257c56f479eaa0b6c27eafa17aacea1ff6fb27e9fc5c3e"} Jul 18 00:55:53.311709 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:53.311687 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqwfv" event={"ID":"429d665b-3f33-48ac-b759-29a4e3faac27","Type":"ContainerStarted","Data":"8ff8fc28b3e5e997cfa6e906ea3d91cb2997e1c249dc3a8f1ad01e1d402cbf04"} Jul 18 00:55:53.311766 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:53.311738 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bqwfv" Jul 18 00:55:53.311766 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:53.311755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bqwfv" event={"ID":"429d665b-3f33-48ac-b759-29a4e3faac27","Type":"ContainerStarted","Data":"592f4ae38746d7e305211b911c7c3cb2b841dea61af754d6d7b7c0e6ff7d8d8a"} Jul 18 00:55:53.326362 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:53.326316 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" podStartSLOduration=9.326300704 podStartE2EDuration="9.326300704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:50.325902506 +0000 UTC m=+49.851666183" watchObservedRunningTime="2026-07-18 00:55:53.326300704 +0000 UTC m=+52.852064380" Jul 18 00:55:53.326480 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:53.326423 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9z2bf" podStartSLOduration=2.335464226 podStartE2EDuration="5.326418289s" totalImagesPullingTime="2.990954063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:53.325546021 +0000 UTC m=+52.851309696" watchObservedRunningTime="2026-07-18 00:55:53.326418289 +0000 UTC m=+52.852181964" Jul 18 00:55:53.341812 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:53.341766 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bqwfv" podStartSLOduration=2.340538021 podStartE2EDuration="5.341748808s" totalImagesPullingTime="3.001210787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:55:53.341096311 +0000 UTC m=+52.866860001" watchObservedRunningTime="2026-07-18 00:55:53.341748808 +0000 UTC m=+52.867512460" Jul 18 00:55:57.963036 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:57.962993 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tzsm5"] Jul 18 00:55:58.004063 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.004007 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tzsm5"] Jul 18 00:55:58.004217 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.004138 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.006442 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.006422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 18 00:55:58.006570 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.006487 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 18 00:55:58.006726 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.006711 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 18 00:55:58.007417 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.007404 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 18 00:55:58.007478 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.007418 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xm8x4\"" Jul 18 00:55:58.020653 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.020630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.020748 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.020673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/324a1c33-e2d2-4345-97f0-02388e471bbc-crio-socket\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.020748 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.020691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/324a1c33-e2d2-4345-97f0-02388e471bbc-data-volume\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.020815 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.020775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.020815 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.020800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z5js\" (UniqueName: \"kubernetes.io/projected/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-api-access-9z5js\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.121148 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.121106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.121324 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.121165 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/324a1c33-e2d2-4345-97f0-02388e471bbc-crio-socket\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.121324 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.121192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/324a1c33-e2d2-4345-97f0-02388e471bbc-data-volume\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.121324 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.121223 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.121324 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.121241 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z5js\" (UniqueName: \"kubernetes.io/projected/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-api-access-9z5js\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.121324 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.121252 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:55:58.121324 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.121311 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls podName:324a1c33-e2d2-4345-97f0-02388e471bbc nodeName:}" failed. No retries permitted until 2026-07-18 00:55:58.621295842 +0000 UTC m=+58.147059496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tzsm5" (UID: "324a1c33-e2d2-4345-97f0-02388e471bbc") : secret "insights-runtime-extractor-tls" not found Jul 18 00:55:58.121324 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.121317 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:55:58.121645 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.121375 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm podName:324a1c33-e2d2-4345-97f0-02388e471bbc nodeName:}" failed. No retries permitted until 2026-07-18 00:55:58.621358815 +0000 UTC m=+58.147122481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tzsm5" (UID: "324a1c33-e2d2-4345-97f0-02388e471bbc") : configmap "kube-rbac-proxy" not found Jul 18 00:55:58.121645 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.121439 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/324a1c33-e2d2-4345-97f0-02388e471bbc-crio-socket\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.121645 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.121543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/324a1c33-e2d2-4345-97f0-02388e471bbc-data-volume\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.136011 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.135977 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z5js\" (UniqueName: \"kubernetes.io/projected/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-api-access-9z5js\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.623704 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.623661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.623878 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:58.623723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:58.623878 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.623790 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:55:58.623878 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.623834 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:55:58.623878 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.623855 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm podName:324a1c33-e2d2-4345-97f0-02388e471bbc nodeName:}" failed. No retries permitted until 2026-07-18 00:55:59.623839065 +0000 UTC m=+59.149602721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tzsm5" (UID: "324a1c33-e2d2-4345-97f0-02388e471bbc") : configmap "kube-rbac-proxy" not found Jul 18 00:55:58.623878 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:58.623874 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls podName:324a1c33-e2d2-4345-97f0-02388e471bbc nodeName:}" failed. No retries permitted until 2026-07-18 00:55:59.623862755 +0000 UTC m=+59.149626409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tzsm5" (UID: "324a1c33-e2d2-4345-97f0-02388e471bbc") : secret "insights-runtime-extractor-tls" not found Jul 18 00:55:59.010416 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:59.010334 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqwfv_429d665b-3f33-48ac-b759-29a4e3faac27/dns/0.log" Jul 18 00:55:59.170592 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:59.170567 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqwfv_429d665b-3f33-48ac-b759-29a4e3faac27/kube-rbac-proxy/0.log" Jul 18 00:55:59.630416 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:59.630381 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:59.630593 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:55:59.630443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:55:59.630593 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:59.630509 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 18 00:55:59.630593 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:59.630543 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 18 00:55:59.630593 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:59.630573 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm podName:324a1c33-e2d2-4345-97f0-02388e471bbc nodeName:}" failed. No retries permitted until 2026-07-18 00:56:01.630557979 +0000 UTC m=+61.156321635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tzsm5" (UID: "324a1c33-e2d2-4345-97f0-02388e471bbc") : configmap "kube-rbac-proxy" not found Jul 18 00:55:59.630593 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:55:59.630595 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls podName:324a1c33-e2d2-4345-97f0-02388e471bbc nodeName:}" failed. No retries permitted until 2026-07-18 00:56:01.630581705 +0000 UTC m=+61.156345361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tzsm5" (UID: "324a1c33-e2d2-4345-97f0-02388e471bbc") : secret "insights-runtime-extractor-tls" not found Jul 18 00:56:00.171186 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:00.171154 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9sqfs_a6d5b666-4557-4d4f-a832-ba629e3d3496/dns-node-resolver/0.log" Jul 18 00:56:00.970708 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:00.970684 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fc4b8c4d9-hb6f9_d8d57ad7-f36b-47b9-9e9b-837e2c852930/registry/0.log" Jul 18 00:56:01.171891 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:01.171865 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f58nz_dbb5603a-6e72-4433-b26c-8d6e4a2fec12/node-ca/0.log" Jul 18 00:56:01.645352 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:01.645319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:56:01.645530 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:01.645378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:56:01.645883 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:01.645855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/324a1c33-e2d2-4345-97f0-02388e471bbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:56:01.647736 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:01.647714 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/324a1c33-e2d2-4345-97f0-02388e471bbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tzsm5\" (UID: \"324a1c33-e2d2-4345-97f0-02388e471bbc\") " pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:56:01.915586 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:01.915505 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xm8x4\"" Jul 18 00:56:01.923695 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:01.923667 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tzsm5" Jul 18 00:56:02.084574 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.084544 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tzsm5"] Jul 18 00:56:02.087608 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:02.087581 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324a1c33_e2d2_4345_97f0_02388e471bbc.slice/crio-10c503b17ad28376fec64888058f4199c39335f8572b7e051aabe86f69d9e896 WatchSource:0}: Error finding container 10c503b17ad28376fec64888058f4199c39335f8572b7e051aabe86f69d9e896: Status 404 returned error can't find the container with id 10c503b17ad28376fec64888058f4199c39335f8572b7e051aabe86f69d9e896 Jul 18 00:56:02.171520 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.171437 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9z2bf_aa025570-afe5-4a85-8d35-960b77280485/serve-healthcheck-canary/0.log" Jul 18 00:56:02.257592 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.257556 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4njhd" Jul 18 00:56:02.333816 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.333785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzsm5" event={"ID":"324a1c33-e2d2-4345-97f0-02388e471bbc","Type":"ContainerStarted","Data":"10c503b17ad28376fec64888058f4199c39335f8572b7e051aabe86f69d9e896"} Jul 18 00:56:02.556201 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.556127 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fthjp"] Jul 18 00:56:02.566747 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.566720 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.568938 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.568898 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fthjp"] Jul 18 00:56:02.569198 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.569183 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 18 00:56:02.569335 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.569313 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 18 00:56:02.569404 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.569340 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 18 00:56:02.569563 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.569547 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 18 00:56:02.569614 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.569561 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v69rg\"" Jul 18 00:56:02.569614 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.569565 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 18 00:56:02.653865 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.653835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.653865 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.653872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.654121 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.653957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1997a68-235d-4663-a2b0-a8821897a4e2-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.654121 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.653996 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgk28\" (UniqueName: \"kubernetes.io/projected/a1997a68-235d-4663-a2b0-a8821897a4e2-kube-api-access-sgk28\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.755314 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.755280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.755487 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.755324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.755487 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.755370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1997a68-235d-4663-a2b0-a8821897a4e2-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.755487 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.755414 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgk28\" (UniqueName: \"kubernetes.io/projected/a1997a68-235d-4663-a2b0-a8821897a4e2-kube-api-access-sgk28\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.755876 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:02.755850 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 18 00:56:02.756000 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:02.755937 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-tls podName:a1997a68-235d-4663-a2b0-a8821897a4e2 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:03.255920944 +0000 UTC m=+62.781684597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-fthjp" (UID: "a1997a68-235d-4663-a2b0-a8821897a4e2") : secret "prometheus-operator-tls" not found Jul 18 00:56:02.757141 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.757120 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1997a68-235d-4663-a2b0-a8821897a4e2-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.759182 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.759157 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:02.766164 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:02.766138 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgk28\" (UniqueName: \"kubernetes.io/projected/a1997a68-235d-4663-a2b0-a8821897a4e2-kube-api-access-sgk28\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:03.259292 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:03.259249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:03.262428 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:03.262399 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1997a68-235d-4663-a2b0-a8821897a4e2-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fthjp\" (UID: \"a1997a68-235d-4663-a2b0-a8821897a4e2\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:03.317403 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:03.317353 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bqwfv" Jul 18 00:56:03.476520 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:03.476487 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" Jul 18 00:56:03.639754 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:03.639666 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fthjp"] Jul 18 00:56:03.644884 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:03.644851 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1997a68_235d_4663_a2b0_a8821897a4e2.slice/crio-5a1a13de3aaea00dfd826d44c02fb2010af49580c74f728481af1ddd9931b4d4 WatchSource:0}: Error finding container 5a1a13de3aaea00dfd826d44c02fb2010af49580c74f728481af1ddd9931b4d4: Status 404 returned error can't find the container with id 5a1a13de3aaea00dfd826d44c02fb2010af49580c74f728481af1ddd9931b4d4 Jul 18 00:56:04.340831 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:04.340756 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" event={"ID":"a1997a68-235d-4663-a2b0-a8821897a4e2","Type":"ContainerStarted","Data":"5a1a13de3aaea00dfd826d44c02fb2010af49580c74f728481af1ddd9931b4d4"} Jul 18 00:56:06.688343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.688290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:56:06.688343 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.688349 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:56:06.690551 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.690523 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 18 00:56:06.691347 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.691327 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 18 00:56:06.701530 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.701507 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01ef9a9-c90f-4009-8ae4-1c6dc5691867-metrics-certs\") pod \"network-metrics-daemon-9fhcl\" (UID: \"f01ef9a9-c90f-4009-8ae4-1c6dc5691867\") " pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:56:06.701654 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.701568 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/22ca3617-ae2d-49ea-a5e8-42287275a957-original-pull-secret\") pod \"global-pull-secret-syncer-6xngz\" (UID: \"22ca3617-ae2d-49ea-a5e8-42287275a957\") " pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:56:06.724798 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.724765 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6xngz" Jul 18 00:56:06.731319 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.731291 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9d8vg\"" Jul 18 00:56:06.739063 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.739040 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9fhcl" Jul 18 00:56:06.889958 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.889922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:56:06.892651 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.892633 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 18 00:56:06.902325 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.902301 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 18 00:56:06.913624 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:06.913601 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j67q5\" (UniqueName: \"kubernetes.io/projected/ddde3482-fd39-4276-96f9-68124e138c9d-kube-api-access-j67q5\") pod \"network-check-target-px7qh\" (UID: \"ddde3482-fd39-4276-96f9-68124e138c9d\") " pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:56:07.021403 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:07.021377 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4tv4\"" Jul 18 00:56:07.029265 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:07.029235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:56:07.760557 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:07.760278 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6xngz"] Jul 18 00:56:07.765836 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:07.765738 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ca3617_ae2d_49ea_a5e8_42287275a957.slice/crio-756023560b31727e21d48963aeff67eb82df56a735eef4d9c08e1df66fcc5c80 WatchSource:0}: Error finding container 756023560b31727e21d48963aeff67eb82df56a735eef4d9c08e1df66fcc5c80: Status 404 returned error can't find the container with id 756023560b31727e21d48963aeff67eb82df56a735eef4d9c08e1df66fcc5c80 Jul 18 00:56:07.777395 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:07.777368 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-px7qh"] Jul 18 00:56:07.783590 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:07.783555 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9fhcl"] Jul 18 00:56:07.783706 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:07.783688 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddde3482_fd39_4276_96f9_68124e138c9d.slice/crio-15ca88eb544646d3d6996be96c352a69dd5f99d926f0b5b4307675be5e80eb18 WatchSource:0}: Error finding container 15ca88eb544646d3d6996be96c352a69dd5f99d926f0b5b4307675be5e80eb18: Status 404 returned error can't find the container with id 15ca88eb544646d3d6996be96c352a69dd5f99d926f0b5b4307675be5e80eb18 Jul 18 00:56:07.787355 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:07.787331 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01ef9a9_c90f_4009_8ae4_1c6dc5691867.slice/crio-5bde63a314a697b368009fc026eafbd5196aa74831a107673fa927941569576c WatchSource:0}: Error finding container 5bde63a314a697b368009fc026eafbd5196aa74831a107673fa927941569576c: Status 404 returned error can't find the container with id 5bde63a314a697b368009fc026eafbd5196aa74831a107673fa927941569576c Jul 18 00:56:08.362165 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:08.362125 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzsm5" event={"ID":"324a1c33-e2d2-4345-97f0-02388e471bbc","Type":"ContainerStarted","Data":"2032f1a00655380fd2d5a25015be924a342fff87e5e3b14dac04124594ac4807"} Jul 18 00:56:08.363888 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:08.363846 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-px7qh" event={"ID":"ddde3482-fd39-4276-96f9-68124e138c9d","Type":"ContainerStarted","Data":"15ca88eb544646d3d6996be96c352a69dd5f99d926f0b5b4307675be5e80eb18"} Jul 18 00:56:08.366451 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:08.366427 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" event={"ID":"a1997a68-235d-4663-a2b0-a8821897a4e2","Type":"ContainerStarted","Data":"5f2aa95ade2e4846125adfdf2f144fa8d43e6d032c1d7139028f2a65770da737"} Jul 18 00:56:08.366599 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:08.366472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" event={"ID":"a1997a68-235d-4663-a2b0-a8821897a4e2","Type":"ContainerStarted","Data":"456747f4e15e4e13a36584e3c55d86c0fd9554b4adbd4d49f428db5f9f7477a2"} Jul 18 00:56:08.368318 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:08.368285 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9fhcl" event={"ID":"f01ef9a9-c90f-4009-8ae4-1c6dc5691867","Type":"ContainerStarted","Data":"5bde63a314a697b368009fc026eafbd5196aa74831a107673fa927941569576c"} Jul 18 00:56:08.370307 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:08.369938 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xngz" event={"ID":"22ca3617-ae2d-49ea-a5e8-42287275a957","Type":"ContainerStarted","Data":"756023560b31727e21d48963aeff67eb82df56a735eef4d9c08e1df66fcc5c80"} Jul 18 00:56:08.384550 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:08.383710 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fthjp" podStartSLOduration=2.434980714 podStartE2EDuration="6.383688818s" totalImagesPullingTime="3.948708104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:08.383194639 +0000 UTC m=+67.908958341" watchObservedRunningTime="2026-07-18 00:56:08.383688818 +0000 UTC m=+67.909452493" Jul 18 00:56:09.898652 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.898615 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9"] Jul 18 00:56:09.902937 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.902907 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:09.905298 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.905267 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bq5nt\"" Jul 18 00:56:09.905531 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.905512 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 18 00:56:09.905795 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.905772 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 18 00:56:09.910519 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.910493 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9"] Jul 18 00:56:09.920655 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.920629 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cxmrr"] Jul 18 00:56:09.923036 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.922948 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:09.926289 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.926257 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 18 00:56:09.926289 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.926289 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 18 00:56:09.926482 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.926335 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cwzpn\"" Jul 18 00:56:09.926482 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:09.926258 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 18 00:56:10.014759 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014720 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.014942 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-tls\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.014942 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-textfile\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.014942 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.014942 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.014942 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014908 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sdd9\" (UniqueName: \"kubernetes.io/projected/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-kube-api-access-4sdd9\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.014942 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014923 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcrbr\" (UniqueName: \"kubernetes.io/projected/a9c4aa18-4287-47e5-a18e-1e18268b228e-kube-api-access-fcrbr\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.014942 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-sys\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.015334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014965 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-wtmp\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.015334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.014994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9c4aa18-4287-47e5-a18e-1e18268b228e-metrics-client-ca\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.015334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.015044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.015334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.015071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.015334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.015087 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-root\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116119 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.116119 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116125 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sdd9\" (UniqueName: \"kubernetes.io/projected/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-kube-api-access-4sdd9\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.116364 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcrbr\" (UniqueName: \"kubernetes.io/projected/a9c4aa18-4287-47e5-a18e-1e18268b228e-kube-api-access-fcrbr\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116364 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-sys\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116364 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-wtmp\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116364 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116251 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-sys\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9c4aa18-4287-47e5-a18e-1e18268b228e-metrics-client-ca\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116459 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-wtmp\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.116568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-root\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116817 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:10.116589 2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 18 00:56:10.116817 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.116817 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:10.116659 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-tls podName:82c4cd08-4ed6-4ff8-a126-5c20f4d08c06 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:10.616628107 +0000 UTC m=+70.142391766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-npnp9" (UID: "82c4cd08-4ed6-4ff8-a126-5c20f4d08c06") : secret "openshift-state-metrics-tls" not found Jul 18 00:56:10.116817 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-tls\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116817 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116755 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-textfile\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.116817 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.116787 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.117149 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.117129 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9c4aa18-4287-47e5-a18e-1e18268b228e-metrics-client-ca\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.117207 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.117192 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a9c4aa18-4287-47e5-a18e-1e18268b228e-root\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.117388 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.117319 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.117388 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.117338 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.117572 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.117554 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-textfile\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.119824 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.119788 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.120664 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.120635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.120755 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.120704 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a9c4aa18-4287-47e5-a18e-1e18268b228e-node-exporter-tls\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.126862 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.126816 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sdd9\" (UniqueName: \"kubernetes.io/projected/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-kube-api-access-4sdd9\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.133155 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.133108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcrbr\" (UniqueName: \"kubernetes.io/projected/a9c4aa18-4287-47e5-a18e-1e18268b228e-kube-api-access-fcrbr\") pod \"node-exporter-cxmrr\" (UID: \"a9c4aa18-4287-47e5-a18e-1e18268b228e\") " pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.236598 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.236519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxmrr" Jul 18 00:56:10.381931 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.381896 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9fhcl" event={"ID":"f01ef9a9-c90f-4009-8ae4-1c6dc5691867","Type":"ContainerStarted","Data":"347708f46c6c9d4c888b80f184e07e2dfb5672069ae2b8a245866c09f1bbbe73"} Jul 18 00:56:10.382133 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.381951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9fhcl" event={"ID":"f01ef9a9-c90f-4009-8ae4-1c6dc5691867","Type":"ContainerStarted","Data":"7e5919753b8a53e6d710dfdba2bf745ef4e4905539d3511dd7b46838c85657b1"} Jul 18 00:56:10.397915 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.397838 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9fhcl" podStartSLOduration=67.891713969 podStartE2EDuration="1m9.397815277s" totalImagesPullingTime="1.506101308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:10.397357521 +0000 UTC m=+69.923121198" watchObservedRunningTime="2026-07-18 00:56:10.397815277 +0000 UTC m=+69.923578953" Jul 18 00:56:10.622853 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.622820 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.625948 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.625919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82c4cd08-4ed6-4ff8-a126-5c20f4d08c06-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-npnp9\" (UID: \"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.817520 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.817478 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" Jul 18 00:56:10.977699 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.977601 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:56:10.984217 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.984191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:10.986860 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.986835 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-85ztn\"" Jul 18 00:56:10.987062 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.987045 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 18 00:56:10.989408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.987301 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 18 00:56:10.989408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.988594 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 18 00:56:10.989408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.988817 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 18 00:56:10.989408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.988969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 18 00:56:10.989408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.988994 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 18 00:56:10.989408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.989241 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 18 00:56:10.989408 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.989258 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 18 00:56:10.989718 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.989442 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 18 00:56:10.998849 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:10.998822 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:56:11.025232 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025407 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a4c7a6e-de1a-47ce-8124-274155d5cf27-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025407 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025407 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025407 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025321 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a4c7a6e-de1a-47ce-8124-274155d5cf27-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025620 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-web-config\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025620 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a4c7a6e-de1a-47ce-8124-274155d5cf27-config-out\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025620 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025479 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4c7a6e-de1a-47ce-8124-274155d5cf27-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025620 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a4c7a6e-de1a-47ce-8124-274155d5cf27-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025620 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg29j\" (UniqueName: \"kubernetes.io/projected/3a4c7a6e-de1a-47ce-8124-274155d5cf27-kube-api-access-dg29j\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025872 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025872 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.025872 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.025712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.126913 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.126868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg29j\" (UniqueName: \"kubernetes.io/projected/3a4c7a6e-de1a-47ce-8124-274155d5cf27-kube-api-access-dg29j\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127113 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.126930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127113 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.126965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127113 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.126989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127113 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127042 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127320 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:11.127140 2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 18 00:56:11.127320 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:11.127209 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-main-tls podName:3a4c7a6e-de1a-47ce-8124-274155d5cf27 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:11.62719191 +0000 UTC m=+71.152955571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3a4c7a6e-de1a-47ce-8124-274155d5cf27") : secret "alertmanager-main-tls" not found Jul 18 00:56:11.127320 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a4c7a6e-de1a-47ce-8124-274155d5cf27-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127501 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127362 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127501 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127501 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a4c7a6e-de1a-47ce-8124-274155d5cf27-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127501 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-web-config\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127687 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a4c7a6e-de1a-47ce-8124-274155d5cf27-config-out\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127687 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127540 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4c7a6e-de1a-47ce-8124-274155d5cf27-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127687 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a4c7a6e-de1a-47ce-8124-274155d5cf27-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.127846 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.127736 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a4c7a6e-de1a-47ce-8124-274155d5cf27-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.129212 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.128387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a4c7a6e-de1a-47ce-8124-274155d5cf27-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.129559 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.129512 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4c7a6e-de1a-47ce-8124-274155d5cf27-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.130828 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.130803 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.131500 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.131433 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.131500 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.131482 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a4c7a6e-de1a-47ce-8124-274155d5cf27-config-out\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.132073 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.132050 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.132175 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.132143 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.132399 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.132369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.132592 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.132575 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-web-config\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.133378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.133305 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a4c7a6e-de1a-47ce-8124-274155d5cf27-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.135034 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.135000 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg29j\" (UniqueName: \"kubernetes.io/projected/3a4c7a6e-de1a-47ce-8124-274155d5cf27-kube-api-access-dg29j\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.631361 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.631315 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.634109 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.634086 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a4c7a6e-de1a-47ce-8124-274155d5cf27-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a4c7a6e-de1a-47ce-8124-274155d5cf27\") " pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:11.900885 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:11.900803 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 18 00:56:12.312858 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:12.312772 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5fc4b8c4d9-hb6f9" Jul 18 00:56:14.422386 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:14.422349 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c4aa18_4287_47e5_a18e_1e18268b228e.slice/crio-22dd34fe87a3ae78bcc033b73668cce33fa55426b29063e5b91e9c563f0a0dbe WatchSource:0}: Error finding container 22dd34fe87a3ae78bcc033b73668cce33fa55426b29063e5b91e9c563f0a0dbe: Status 404 returned error can't find the container with id 22dd34fe87a3ae78bcc033b73668cce33fa55426b29063e5b91e9c563f0a0dbe Jul 18 00:56:14.582696 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.582641 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9"] Jul 18 00:56:14.604822 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.604794 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 18 00:56:14.608478 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:14.608446 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4c7a6e_de1a_47ce_8124_274155d5cf27.slice/crio-5e1527603c352c66c2eff51ff0e61aba36b3af16f78c1360ac3f02ba604b2a5c WatchSource:0}: Error finding container 5e1527603c352c66c2eff51ff0e61aba36b3af16f78c1360ac3f02ba604b2a5c: Status 404 returned error can't find the container with id 5e1527603c352c66c2eff51ff0e61aba36b3af16f78c1360ac3f02ba604b2a5c Jul 18 00:56:14.692784 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.692761 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8"] Jul 18 00:56:14.694745 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.694726 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:14.697415 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.697393 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 18 00:56:14.697415 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.697406 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dnjd6\"" Jul 18 00:56:14.706178 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.706140 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8"] Jul 18 00:56:14.757453 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.757410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1531dd6-9366-4428-916d-941007be6433-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-55wd8\" (UID: \"d1531dd6-9366-4428-916d-941007be6433\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:14.757618 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.757473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qwm9\" (UniqueName: \"kubernetes.io/projected/d1531dd6-9366-4428-916d-941007be6433-kube-api-access-4qwm9\") pod \"monitoring-plugin-7b7b7bc8bf-55wd8\" (UID: \"d1531dd6-9366-4428-916d-941007be6433\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:14.857986 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.857902 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1531dd6-9366-4428-916d-941007be6433-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-55wd8\" (UID: \"d1531dd6-9366-4428-916d-941007be6433\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:14.857986 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.857947 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qwm9\" (UniqueName: \"kubernetes.io/projected/d1531dd6-9366-4428-916d-941007be6433-kube-api-access-4qwm9\") pod \"monitoring-plugin-7b7b7bc8bf-55wd8\" (UID: \"d1531dd6-9366-4428-916d-941007be6433\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:14.858229 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:14.858097 2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 18 00:56:14.858229 ip-10-0-133-101 kubenswrapper[2556]: E0718 00:56:14.858160 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1531dd6-9366-4428-916d-941007be6433-monitoring-plugin-cert podName:d1531dd6-9366-4428-916d-941007be6433 nodeName:}" failed. No retries permitted until 2026-07-18 00:56:15.358142884 +0000 UTC m=+74.883906538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d1531dd6-9366-4428-916d-941007be6433-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-55wd8" (UID: "d1531dd6-9366-4428-916d-941007be6433") : secret "monitoring-plugin-cert" not found Jul 18 00:56:14.869203 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:14.869165 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qwm9\" (UniqueName: \"kubernetes.io/projected/d1531dd6-9366-4428-916d-941007be6433-kube-api-access-4qwm9\") pod \"monitoring-plugin-7b7b7bc8bf-55wd8\" (UID: \"d1531dd6-9366-4428-916d-941007be6433\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:15.363776 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.363234 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1531dd6-9366-4428-916d-941007be6433-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-55wd8\" (UID: \"d1531dd6-9366-4428-916d-941007be6433\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:15.366818 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.366785 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d1531dd6-9366-4428-916d-941007be6433-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-55wd8\" (UID: \"d1531dd6-9366-4428-916d-941007be6433\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:15.404963 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.404884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzsm5" event={"ID":"324a1c33-e2d2-4345-97f0-02388e471bbc","Type":"ContainerStarted","Data":"c7d64efac2eba009487209b5788713e4904b2d9939db0a7daaa10d17826a58a9"} Jul 18 00:56:15.407552 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.407519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-px7qh" event={"ID":"ddde3482-fd39-4276-96f9-68124e138c9d","Type":"ContainerStarted","Data":"ece45fbd27e6379e2382d3b2fa6be022e471a8911238a029ae2299907edf918e"} Jul 18 00:56:15.408323 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.408301 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:56:15.409734 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.409708 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerStarted","Data":"5e1527603c352c66c2eff51ff0e61aba36b3af16f78c1360ac3f02ba604b2a5c"} Jul 18 00:56:15.413374 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.413259 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" event={"ID":"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06","Type":"ContainerStarted","Data":"c86ba0f6a279c577d3094f003ca8289a8f3c87ef9cdf93b4b9ea0098d7083a37"} Jul 18 00:56:15.413374 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.413312 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" event={"ID":"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06","Type":"ContainerStarted","Data":"a9d01755d4528a939d267c7f7a3df1cc0ea91fcb83861ea09a430273dd45c848"} Jul 18 00:56:15.413374 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.413342 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" event={"ID":"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06","Type":"ContainerStarted","Data":"f01517275514a79bb13a2072d628fe6f38461ba3959951b54d17e328fcf48976"} Jul 18 00:56:15.415503 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.415483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6xngz" event={"ID":"22ca3617-ae2d-49ea-a5e8-42287275a957","Type":"ContainerStarted","Data":"6de60fffa065ae8adaf342448f6adf1710dde5fcfc80feb5111ac2dad49429ca"} Jul 18 00:56:15.418117 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.418090 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxmrr" event={"ID":"a9c4aa18-4287-47e5-a18e-1e18268b228e","Type":"ContainerStarted","Data":"22dd34fe87a3ae78bcc033b73668cce33fa55426b29063e5b91e9c563f0a0dbe"} Jul 18 00:56:15.427106 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.426135 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-px7qh" podStartSLOduration=67.771077278 podStartE2EDuration="1m14.426114996s" totalImagesPullingTime="6.655037718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:15.425061057 +0000 UTC m=+74.950824746" watchObservedRunningTime="2026-07-18 00:56:15.426114996 +0000 UTC m=+74.951878675" Jul 18 00:56:15.608276 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:15.608241 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:16.574751 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:16.574446 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6xngz" podStartSLOduration=68.925396509 podStartE2EDuration="1m15.574424914s" totalImagesPullingTime="6.649028405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:15.439108788 +0000 UTC m=+74.964872466" watchObservedRunningTime="2026-07-18 00:56:16.574424914 +0000 UTC m=+76.100188589" Jul 18 00:56:16.575845 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:16.575768 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8"] Jul 18 00:56:16.578993 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:56:16.578960 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1531dd6_9366_4428_916d_941007be6433.slice/crio-82a9d73ec63cf60969c57980fdca434436787d4625c383d07898477b8be8f550 WatchSource:0}: Error finding container 82a9d73ec63cf60969c57980fdca434436787d4625c383d07898477b8be8f550: Status 404 returned error can't find the container with id 82a9d73ec63cf60969c57980fdca434436787d4625c383d07898477b8be8f550 Jul 18 00:56:17.430387 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:17.430344 2556 generic.go:356] "Generic (PLEG): container finished" podID="3a4c7a6e-de1a-47ce-8124-274155d5cf27" containerID="81560f2373239f203b70570e13c11d107a1f67bfafdb33521463e69fa6a82166" exitCode=0 Jul 18 00:56:17.430569 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:17.430430 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerDied","Data":"81560f2373239f203b70570e13c11d107a1f67bfafdb33521463e69fa6a82166"} Jul 18 00:56:17.433044 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:17.432951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" event={"ID":"82c4cd08-4ed6-4ff8-a126-5c20f4d08c06","Type":"ContainerStarted","Data":"0616b062a50760c426141e48dc3810ea1b980132d00ac1cb71079cf445a64805"} Jul 18 00:56:17.434738 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:17.434717 2556 generic.go:356] "Generic (PLEG): container finished" podID="a9c4aa18-4287-47e5-a18e-1e18268b228e" containerID="7c5b7c51cc5a0b3196e137693d21ab5e53fd799718fe313af18fa3e71fa737af" exitCode=0 Jul 18 00:56:17.434844 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:17.434794 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxmrr" event={"ID":"a9c4aa18-4287-47e5-a18e-1e18268b228e","Type":"ContainerDied","Data":"7c5b7c51cc5a0b3196e137693d21ab5e53fd799718fe313af18fa3e71fa737af"} Jul 18 00:56:17.436179 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:17.436152 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" event={"ID":"d1531dd6-9366-4428-916d-941007be6433","Type":"ContainerStarted","Data":"82a9d73ec63cf60969c57980fdca434436787d4625c383d07898477b8be8f550"} Jul 18 00:56:17.501110 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:17.501057 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-npnp9" podStartSLOduration=6.8462472850000005 podStartE2EDuration="8.501035399s" totalImagesPullingTime="1.654788114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:17.500344597 +0000 UTC m=+77.026108295" watchObservedRunningTime="2026-07-18 00:56:17.501035399 +0000 UTC m=+77.026799072" Jul 18 00:56:19.452551 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:19.452510 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxmrr" event={"ID":"a9c4aa18-4287-47e5-a18e-1e18268b228e","Type":"ContainerStarted","Data":"cf89e19b2f3a32b479240ff182f41e9afaadb5097cbc616ec7936473f2656923"} Jul 18 00:56:19.453056 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:19.452596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxmrr" event={"ID":"a9c4aa18-4287-47e5-a18e-1e18268b228e","Type":"ContainerStarted","Data":"0d6104f8639c99e38a629668d57c28516496024e1d5e014e71595653c0785eaf"} Jul 18 00:56:19.456475 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:19.456439 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tzsm5" event={"ID":"324a1c33-e2d2-4345-97f0-02388e471bbc","Type":"ContainerStarted","Data":"d69b54b9cb9d0dd0c2a968bd84901fad57063da4a1da2f33cb38eed91203340f"} Jul 18 00:56:19.474099 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:19.474037 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cxmrr" podStartSLOduration=8.431376552 podStartE2EDuration="10.473999464s" totalImagesPullingTime="1.921379981s" totalInitContainerRuntime="121.242931ms" isStatefulPod=true podCreationTimestamp="2026-07-18 00:56:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:19.473416381 +0000 UTC m=+78.999180058" watchObservedRunningTime="2026-07-18 00:56:19.473999464 +0000 UTC m=+78.999763140" Jul 18 00:56:19.490561 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:19.490501 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tzsm5" podStartSLOduration=6.25246372 podStartE2EDuration="22.49048499s" totalImagesPullingTime="16.23802127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 00:55:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:19.489796977 +0000 UTC m=+79.015560654" watchObservedRunningTime="2026-07-18 00:56:19.49048499 +0000 UTC m=+79.016248665" Jul 18 00:56:20.463150 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:20.463113 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerStarted","Data":"4f379244721e60e202c72d5f38f2ee09e85fcd89902fbc99b1e2d67a560a3e5a"} Jul 18 00:56:20.463576 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:20.463183 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerStarted","Data":"c90c373b928989931d310731cf718b7dcc4c0e424843785e04a299a307b9e475"} Jul 18 00:56:20.463576 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:20.463216 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerStarted","Data":"85f840724ddf1e6f5bc6f7cbe7cae3eb4f0976fc79b11ec3e58ea8d51cc18078"} Jul 18 00:56:20.463576 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:20.463242 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerStarted","Data":"3ec2b29d376aa5eda3e2e6672ddc90da827b3a8b2d99d705a267890d776bb457"} Jul 18 00:56:20.463576 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:20.463263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerStarted","Data":"5589870f3e66f6a92c90c116ef09d0c4144420d570c6c55085033eed28f33135"} Jul 18 00:56:20.464698 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:20.464668 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" event={"ID":"d1531dd6-9366-4428-916d-941007be6433","Type":"ContainerStarted","Data":"22ba7f206069590e824c04bfa89fdcd2a317388125bdbd28eedc033536b97938"} Jul 18 00:56:20.481389 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:20.481298 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" podStartSLOduration=3.101139002 podStartE2EDuration="6.481283191s" totalImagesPullingTime="3.380144189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:20.480072843 +0000 UTC m=+80.005836538" watchObservedRunningTime="2026-07-18 00:56:20.481283191 +0000 UTC m=+80.007046899" Jul 18 00:56:21.472089 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:21.472048 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a4c7a6e-de1a-47ce-8124-274155d5cf27","Type":"ContainerStarted","Data":"9126f2bb7bef1b77657aa39d1132cf774d50ea77b2dcc0df689d8b219445aeed"} Jul 18 00:56:21.472558 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:21.472327 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:21.477007 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:21.476983 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-55wd8" Jul 18 00:56:21.500248 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:21.500199 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.54592004 podStartE2EDuration="11.500184788s" totalImagesPullingTime="4.932147465s" totalInitContainerRuntime="22.117283ms" isStatefulPod=false podCreationTimestamp="2026-07-18 00:56:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:56:21.499201927 +0000 UTC m=+81.024965618" watchObservedRunningTime="2026-07-18 00:56:21.500184788 +0000 UTC m=+81.025948462" Jul 18 00:56:47.438924 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:56:47.438894 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-px7qh" Jul 18 00:57:34.268199 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.268159 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-756b75cfbb-dtg7q"] Jul 18 00:57:34.271169 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.271144 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.274517 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.274491 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 18 00:57:34.274787 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.274770 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 18 00:57:34.275067 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.275038 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 18 00:57:34.275393 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.275377 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 18 00:57:34.275538 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.275390 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 18 00:57:34.275538 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.275411 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f2hwp\"" Jul 18 00:57:34.281160 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.280909 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 18 00:57:34.285090 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.285067 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756b75cfbb-dtg7q"] Jul 18 00:57:34.383752 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.383721 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-serving-certs-ca-bundle\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.383969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.383771 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.383969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.383795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.383969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.383872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-secret-telemeter-client\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.383969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.383909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-telemeter-client-tls\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.383969 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.383942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-federate-client-tls\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.384178 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.384003 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-metrics-client-ca\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.384178 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.384055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk5qv\" (UniqueName: \"kubernetes.io/projected/da9e62b1-c6e1-40e1-a6cd-5988252a832d-kube-api-access-tk5qv\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485093 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485057 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485093 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485099 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485275 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-secret-telemeter-client\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485275 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-telemeter-client-tls\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485275 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485179 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-federate-client-tls\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485684 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-metrics-client-ca\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485779 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485688 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk5qv\" (UniqueName: \"kubernetes.io/projected/da9e62b1-c6e1-40e1-a6cd-5988252a832d-kube-api-access-tk5qv\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.485779 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.485761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-serving-certs-ca-bundle\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.486862 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.486835 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.489043 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.487491 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-metrics-client-ca\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.489484 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.489424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-telemeter-client-tls\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.489484 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.489347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.489484 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.489461 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-secret-telemeter-client\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.492768 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.492745 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da9e62b1-c6e1-40e1-a6cd-5988252a832d-serving-certs-ca-bundle\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.492857 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.492838 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/da9e62b1-c6e1-40e1-a6cd-5988252a832d-federate-client-tls\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.495858 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.495840 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk5qv\" (UniqueName: \"kubernetes.io/projected/da9e62b1-c6e1-40e1-a6cd-5988252a832d-kube-api-access-tk5qv\") pod \"telemeter-client-756b75cfbb-dtg7q\" (UID: \"da9e62b1-c6e1-40e1-a6cd-5988252a832d\") " pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.582827 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.582733 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" Jul 18 00:57:34.715350 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.714968 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-756b75cfbb-dtg7q"] Jul 18 00:57:34.717985 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:57:34.717955 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9e62b1_c6e1_40e1_a6cd_5988252a832d.slice/crio-7bc18d65d28f6d1e7ba3b60abd63c85b26b21a93a8d8ad746d60a4b3a35fdd60 WatchSource:0}: Error finding container 7bc18d65d28f6d1e7ba3b60abd63c85b26b21a93a8d8ad746d60a4b3a35fdd60: Status 404 returned error can't find the container with id 7bc18d65d28f6d1e7ba3b60abd63c85b26b21a93a8d8ad746d60a4b3a35fdd60 Jul 18 00:57:34.730132 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:34.730105 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" event={"ID":"da9e62b1-c6e1-40e1-a6cd-5988252a832d","Type":"ContainerStarted","Data":"7bc18d65d28f6d1e7ba3b60abd63c85b26b21a93a8d8ad746d60a4b3a35fdd60"} Jul 18 00:57:36.739265 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:36.739239 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" event={"ID":"da9e62b1-c6e1-40e1-a6cd-5988252a832d","Type":"ContainerStarted","Data":"00c1a38cd5521f9bad8eb511ce2df659046b351195f5f3bd3b43704b8852c788"} Jul 18 00:57:36.739552 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:36.739308 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" event={"ID":"da9e62b1-c6e1-40e1-a6cd-5988252a832d","Type":"ContainerStarted","Data":"a37ef90359864b2915194c1775dd30116ccc018128a83309f4a4592154333adf"} Jul 18 00:57:37.744466 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:37.744431 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" event={"ID":"da9e62b1-c6e1-40e1-a6cd-5988252a832d","Type":"ContainerStarted","Data":"f74c414bf8d119f8663f2eca06caf7b7138fbaf62c8f9fbf939f1ddf75faff7d"} Jul 18 00:57:37.766012 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:57:37.765962 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-756b75cfbb-dtg7q" podStartSLOduration=1.8728655669999998 podStartE2EDuration="3.76594315s" totalImagesPullingTime="1.893077583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:57:37.764521485 +0000 UTC m=+157.290285159" watchObservedRunningTime="2026-07-18 00:57:37.76594315 +0000 UTC m=+157.291706826" Jul 18 00:58:45.291933 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.291891 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f"] Jul 18 00:58:45.295268 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.295245 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.297761 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.297733 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 00:58:45.297902 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.297769 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gw2dj\"" Jul 18 00:58:45.298580 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.298566 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 00:58:45.309324 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.309304 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f"] Jul 18 00:58:45.418111 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.418070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgmm\" (UniqueName: \"kubernetes.io/projected/057b050e-b134-4b48-b628-218bc1608eaf-kube-api-access-wqgmm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.418111 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.418114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.418339 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.418155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.519203 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.519166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgmm\" (UniqueName: \"kubernetes.io/projected/057b050e-b134-4b48-b628-218bc1608eaf-kube-api-access-wqgmm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.519203 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.519202 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.519389 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.519234 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.519634 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.519617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.519672 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.519621 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.527659 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.527630 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgmm\" (UniqueName: \"kubernetes.io/projected/057b050e-b134-4b48-b628-218bc1608eaf-kube-api-access-wqgmm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.604159 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.604129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:58:45.731349 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.731316 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f"] Jul 18 00:58:45.735661 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:58:45.735631 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod057b050e_b134_4b48_b628_218bc1608eaf.slice/crio-1427735b3bf824fe21d4c27b4e5a4155c0fea18dcf021e1183a2e0a66476e49b WatchSource:0}: Error finding container 1427735b3bf824fe21d4c27b4e5a4155c0fea18dcf021e1183a2e0a66476e49b: Status 404 returned error can't find the container with id 1427735b3bf824fe21d4c27b4e5a4155c0fea18dcf021e1183a2e0a66476e49b Jul 18 00:58:45.984926 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:45.984834 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" event={"ID":"057b050e-b134-4b48-b628-218bc1608eaf","Type":"ContainerStarted","Data":"1427735b3bf824fe21d4c27b4e5a4155c0fea18dcf021e1183a2e0a66476e49b"} Jul 18 00:58:52.009698 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:52.009611 2556 generic.go:356] "Generic (PLEG): container finished" podID="057b050e-b134-4b48-b628-218bc1608eaf" containerID="1b0fee157d8f6b0b7a80c98a23164834ac5ac59cd39ff383e4322cb587ba20a7" exitCode=0 Jul 18 00:58:52.009698 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:52.009663 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" event={"ID":"057b050e-b134-4b48-b628-218bc1608eaf","Type":"ContainerDied","Data":"1b0fee157d8f6b0b7a80c98a23164834ac5ac59cd39ff383e4322cb587ba20a7"} Jul 18 00:58:55.022181 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:55.022094 2556 generic.go:356] "Generic (PLEG): container finished" podID="057b050e-b134-4b48-b628-218bc1608eaf" containerID="115d514c0e52cba2d41ed7c1d797f8133c53fabb3f6dfbca859659d562ba89e0" exitCode=0 Jul 18 00:58:55.022181 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:58:55.022165 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" event={"ID":"057b050e-b134-4b48-b628-218bc1608eaf","Type":"ContainerDied","Data":"115d514c0e52cba2d41ed7c1d797f8133c53fabb3f6dfbca859659d562ba89e0"} Jul 18 00:59:02.051716 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:02.051680 2556 generic.go:356] "Generic (PLEG): container finished" podID="057b050e-b134-4b48-b628-218bc1608eaf" containerID="f6ff1964b860b1429b0046ce58ada5fa636383009ee689a7ef1c4c37aa6f5c4e" exitCode=0 Jul 18 00:59:02.052159 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:02.051774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" event={"ID":"057b050e-b134-4b48-b628-218bc1608eaf","Type":"ContainerDied","Data":"f6ff1964b860b1429b0046ce58ada5fa636383009ee689a7ef1c4c37aa6f5c4e"} Jul 18 00:59:03.179787 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.179764 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:59:03.269591 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.269551 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-util\") pod \"057b050e-b134-4b48-b628-218bc1608eaf\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " Jul 18 00:59:03.269761 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.269658 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqgmm\" (UniqueName: \"kubernetes.io/projected/057b050e-b134-4b48-b628-218bc1608eaf-kube-api-access-wqgmm\") pod \"057b050e-b134-4b48-b628-218bc1608eaf\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " Jul 18 00:59:03.269761 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.269718 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-bundle\") pod \"057b050e-b134-4b48-b628-218bc1608eaf\" (UID: \"057b050e-b134-4b48-b628-218bc1608eaf\") " Jul 18 00:59:03.270378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.270346 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-bundle" (OuterVolumeSpecName: "bundle") pod "057b050e-b134-4b48-b628-218bc1608eaf" (UID: "057b050e-b134-4b48-b628-218bc1608eaf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:03.271887 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.271863 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/057b050e-b134-4b48-b628-218bc1608eaf-kube-api-access-wqgmm" (OuterVolumeSpecName: "kube-api-access-wqgmm") pod "057b050e-b134-4b48-b628-218bc1608eaf" (UID: "057b050e-b134-4b48-b628-218bc1608eaf"). InnerVolumeSpecName "kube-api-access-wqgmm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:59:03.273865 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.273844 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-util" (OuterVolumeSpecName: "util") pod "057b050e-b134-4b48-b628-218bc1608eaf" (UID: "057b050e-b134-4b48-b628-218bc1608eaf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:03.370308 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.370273 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-bundle\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:03.370308 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.370301 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/057b050e-b134-4b48-b628-218bc1608eaf-util\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:03.370308 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:03.370312 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqgmm\" (UniqueName: \"kubernetes.io/projected/057b050e-b134-4b48-b628-218bc1608eaf-kube-api-access-wqgmm\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:04.061115 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:04.061092 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" Jul 18 00:59:04.061275 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:04.061086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kkg9f" event={"ID":"057b050e-b134-4b48-b628-218bc1608eaf","Type":"ContainerDied","Data":"1427735b3bf824fe21d4c27b4e5a4155c0fea18dcf021e1183a2e0a66476e49b"} Jul 18 00:59:04.061275 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:04.061225 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1427735b3bf824fe21d4c27b4e5a4155c0fea18dcf021e1183a2e0a66476e49b" Jul 18 00:59:08.230194 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230163 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9"] Jul 18 00:59:08.230675 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230577 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057b050e-b134-4b48-b628-218bc1608eaf" containerName="util" Jul 18 00:59:08.230675 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230594 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="057b050e-b134-4b48-b628-218bc1608eaf" containerName="util" Jul 18 00:59:08.230675 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230615 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057b050e-b134-4b48-b628-218bc1608eaf" containerName="extract" Jul 18 00:59:08.230675 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230623 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="057b050e-b134-4b48-b628-218bc1608eaf" containerName="extract" Jul 18 00:59:08.230675 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230642 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="057b050e-b134-4b48-b628-218bc1608eaf" containerName="pull" Jul 18 00:59:08.230675 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230649 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="057b050e-b134-4b48-b628-218bc1608eaf" containerName="pull" Jul 18 00:59:08.230951 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.230721 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="057b050e-b134-4b48-b628-218bc1608eaf" containerName="extract" Jul 18 00:59:08.270708 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.270675 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9"] Jul 18 00:59:08.270876 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.270783 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.273516 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.273485 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 18 00:59:08.273641 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.273543 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 18 00:59:08.275084 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.275068 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-llmdz\"" Jul 18 00:59:08.411931 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.411889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86b89106-7f3a-4bd5-9997-7df0639b767d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzkf9\" (UID: \"86b89106-7f3a-4bd5-9997-7df0639b767d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.412123 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.411940 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58t7\" (UniqueName: \"kubernetes.io/projected/86b89106-7f3a-4bd5-9997-7df0639b767d-kube-api-access-k58t7\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzkf9\" (UID: \"86b89106-7f3a-4bd5-9997-7df0639b767d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.512934 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.512831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86b89106-7f3a-4bd5-9997-7df0639b767d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzkf9\" (UID: \"86b89106-7f3a-4bd5-9997-7df0639b767d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.512934 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.512901 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58t7\" (UniqueName: \"kubernetes.io/projected/86b89106-7f3a-4bd5-9997-7df0639b767d-kube-api-access-k58t7\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzkf9\" (UID: \"86b89106-7f3a-4bd5-9997-7df0639b767d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.513276 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.513255 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86b89106-7f3a-4bd5-9997-7df0639b767d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzkf9\" (UID: \"86b89106-7f3a-4bd5-9997-7df0639b767d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.521183 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.521164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58t7\" (UniqueName: \"kubernetes.io/projected/86b89106-7f3a-4bd5-9997-7df0639b767d-kube-api-access-k58t7\") pod \"cert-manager-operator-controller-manager-55c444bf86-jzkf9\" (UID: \"86b89106-7f3a-4bd5-9997-7df0639b767d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.579613 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.579582 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" Jul 18 00:59:08.736591 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:08.736565 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9"] Jul 18 00:59:08.738769 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:59:08.738740 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b89106_7f3a_4bd5_9997_7df0639b767d.slice/crio-5429b9604f4a86a5cfe9507d04ae6b1387d6ad38ed9e6e93b4d5adbf3257b6ad WatchSource:0}: Error finding container 5429b9604f4a86a5cfe9507d04ae6b1387d6ad38ed9e6e93b4d5adbf3257b6ad: Status 404 returned error can't find the container with id 5429b9604f4a86a5cfe9507d04ae6b1387d6ad38ed9e6e93b4d5adbf3257b6ad Jul 18 00:59:09.080810 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:09.080771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" event={"ID":"86b89106-7f3a-4bd5-9997-7df0639b767d","Type":"ContainerStarted","Data":"5429b9604f4a86a5cfe9507d04ae6b1387d6ad38ed9e6e93b4d5adbf3257b6ad"} Jul 18 00:59:11.090604 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:11.090564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" event={"ID":"86b89106-7f3a-4bd5-9997-7df0639b767d","Type":"ContainerStarted","Data":"05bfd4f7a8ca168a948ff5e9cf3656c5ce5511625bedb6d4f1565321b7129639"} Jul 18 00:59:11.113007 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:11.112906 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jzkf9" podStartSLOduration=0.997219666 podStartE2EDuration="3.112890622s" totalImagesPullingTime="2.115670956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:11.1107789 +0000 UTC m=+250.636542576" watchObservedRunningTime="2026-07-18 00:59:11.112890622 +0000 UTC m=+250.638654297" Jul 18 00:59:12.294592 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.294556 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k4bmw"] Jul 18 00:59:12.315198 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.315157 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w"] Jul 18 00:59:12.315368 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.315277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.317963 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.317938 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 18 00:59:12.318132 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.317938 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wvzjc\"" Jul 18 00:59:12.318132 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.317972 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 18 00:59:12.331225 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.331202 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k4bmw"] Jul 18 00:59:12.331333 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.331231 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w"] Jul 18 00:59:12.331333 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.331318 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.333682 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.333662 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gw2dj\"" Jul 18 00:59:12.333782 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.333682 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 00:59:12.333782 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.333667 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 00:59:12.343563 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.343540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9m9l\" (UniqueName: \"kubernetes.io/projected/adf88969-9a83-4a4e-bc09-0657d01d2f8d-kube-api-access-g9m9l\") pod \"cert-manager-webhook-6486ffd997-k4bmw\" (UID: \"adf88969-9a83-4a4e-bc09-0657d01d2f8d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.343656 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.343576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.343656 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.343596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.343771 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.343685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adf88969-9a83-4a4e-bc09-0657d01d2f8d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k4bmw\" (UID: \"adf88969-9a83-4a4e-bc09-0657d01d2f8d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.343771 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.343721 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcc8\" (UniqueName: \"kubernetes.io/projected/e6d42561-4e82-4043-8b44-64a73d886025-kube-api-access-4dcc8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.444823 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.444791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.445064 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.444833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adf88969-9a83-4a4e-bc09-0657d01d2f8d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k4bmw\" (UID: \"adf88969-9a83-4a4e-bc09-0657d01d2f8d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.445064 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.444861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcc8\" (UniqueName: \"kubernetes.io/projected/e6d42561-4e82-4043-8b44-64a73d886025-kube-api-access-4dcc8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.445064 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.444933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9m9l\" (UniqueName: \"kubernetes.io/projected/adf88969-9a83-4a4e-bc09-0657d01d2f8d-kube-api-access-g9m9l\") pod \"cert-manager-webhook-6486ffd997-k4bmw\" (UID: \"adf88969-9a83-4a4e-bc09-0657d01d2f8d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.445064 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.444983 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.445302 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.445287 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.445347 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.445301 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.460346 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.460319 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/adf88969-9a83-4a4e-bc09-0657d01d2f8d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-k4bmw\" (UID: \"adf88969-9a83-4a4e-bc09-0657d01d2f8d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.461060 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.461037 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9m9l\" (UniqueName: \"kubernetes.io/projected/adf88969-9a83-4a4e-bc09-0657d01d2f8d-kube-api-access-g9m9l\") pod \"cert-manager-webhook-6486ffd997-k4bmw\" (UID: \"adf88969-9a83-4a4e-bc09-0657d01d2f8d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.461947 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.461930 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcc8\" (UniqueName: \"kubernetes.io/projected/e6d42561-4e82-4043-8b44-64a73d886025-kube-api-access-4dcc8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.636257 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.636225 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:12.643470 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.643440 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:12.794120 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.794094 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-k4bmw"] Jul 18 00:59:12.796675 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:59:12.796649 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadf88969_9a83_4a4e_bc09_0657d01d2f8d.slice/crio-7460246d07e386364741646ad20bc6c6e214eebb332173b8cda7681c0fc32220 WatchSource:0}: Error finding container 7460246d07e386364741646ad20bc6c6e214eebb332173b8cda7681c0fc32220: Status 404 returned error can't find the container with id 7460246d07e386364741646ad20bc6c6e214eebb332173b8cda7681c0fc32220 Jul 18 00:59:12.812075 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:12.812054 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w"] Jul 18 00:59:12.814498 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:59:12.814476 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d42561_4e82_4043_8b44_64a73d886025.slice/crio-7fa71359e499cb932ba61534788aa4e0c3ec1bbde7039a75ce8272fc4be1fb77 WatchSource:0}: Error finding container 7fa71359e499cb932ba61534788aa4e0c3ec1bbde7039a75ce8272fc4be1fb77: Status 404 returned error can't find the container with id 7fa71359e499cb932ba61534788aa4e0c3ec1bbde7039a75ce8272fc4be1fb77 Jul 18 00:59:13.100948 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:13.100907 2556 generic.go:356] "Generic (PLEG): container finished" podID="e6d42561-4e82-4043-8b44-64a73d886025" containerID="be90cdc1d83c9155fe8494c518ee9201f958d6adf0ed8ee21b5b09e7644f7d56" exitCode=0 Jul 18 00:59:13.101163 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:13.100966 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" event={"ID":"e6d42561-4e82-4043-8b44-64a73d886025","Type":"ContainerDied","Data":"be90cdc1d83c9155fe8494c518ee9201f958d6adf0ed8ee21b5b09e7644f7d56"} Jul 18 00:59:13.101163 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:13.101042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" event={"ID":"e6d42561-4e82-4043-8b44-64a73d886025","Type":"ContainerStarted","Data":"7fa71359e499cb932ba61534788aa4e0c3ec1bbde7039a75ce8272fc4be1fb77"} Jul 18 00:59:13.102163 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:13.102129 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" event={"ID":"adf88969-9a83-4a4e-bc09-0657d01d2f8d","Type":"ContainerStarted","Data":"7460246d07e386364741646ad20bc6c6e214eebb332173b8cda7681c0fc32220"} Jul 18 00:59:14.293134 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.293049 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-25hf6"] Jul 18 00:59:14.314605 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.314559 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-25hf6"] Jul 18 00:59:14.314780 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.314685 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.317219 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.317193 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-64jhc\"" Jul 18 00:59:14.362353 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.362290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6669\" (UniqueName: \"kubernetes.io/projected/86f9b459-2910-4412-a849-f4c79ac4b3cb-kube-api-access-m6669\") pod \"cert-manager-cainjector-559cdd8c87-25hf6\" (UID: \"86f9b459-2910-4412-a849-f4c79ac4b3cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.362611 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.362376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86f9b459-2910-4412-a849-f4c79ac4b3cb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-25hf6\" (UID: \"86f9b459-2910-4412-a849-f4c79ac4b3cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.463620 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.463578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6669\" (UniqueName: \"kubernetes.io/projected/86f9b459-2910-4412-a849-f4c79ac4b3cb-kube-api-access-m6669\") pod \"cert-manager-cainjector-559cdd8c87-25hf6\" (UID: \"86f9b459-2910-4412-a849-f4c79ac4b3cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.463822 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.463653 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86f9b459-2910-4412-a849-f4c79ac4b3cb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-25hf6\" (UID: \"86f9b459-2910-4412-a849-f4c79ac4b3cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.472787 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.472754 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6669\" (UniqueName: \"kubernetes.io/projected/86f9b459-2910-4412-a849-f4c79ac4b3cb-kube-api-access-m6669\") pod \"cert-manager-cainjector-559cdd8c87-25hf6\" (UID: \"86f9b459-2910-4412-a849-f4c79ac4b3cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.473053 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.473010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86f9b459-2910-4412-a849-f4c79ac4b3cb-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-25hf6\" (UID: \"86f9b459-2910-4412-a849-f4c79ac4b3cb\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.627699 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.627663 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" Jul 18 00:59:14.799804 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:14.799768 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-25hf6"] Jul 18 00:59:16.388590 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:59:16.388555 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86f9b459_2910_4412_a849_f4c79ac4b3cb.slice/crio-257edca6435a984e40c54982b9e8bb7de9414cc7660c8699fdc2e206c74a5560 WatchSource:0}: Error finding container 257edca6435a984e40c54982b9e8bb7de9414cc7660c8699fdc2e206c74a5560: Status 404 returned error can't find the container with id 257edca6435a984e40c54982b9e8bb7de9414cc7660c8699fdc2e206c74a5560 Jul 18 00:59:17.122568 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.122536 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" event={"ID":"adf88969-9a83-4a4e-bc09-0657d01d2f8d","Type":"ContainerStarted","Data":"12876b148cf9bb7c25dfdb9ac28f79dbaa40f667fa0fa8ce2ee8a082fa795210"} Jul 18 00:59:17.122743 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.122648 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:17.124477 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.124452 2556 generic.go:356] "Generic (PLEG): container finished" podID="e6d42561-4e82-4043-8b44-64a73d886025" containerID="e53e24750e181a7f0241316868b28574f5f32f79b5f485d8506eb7221ec10aed" exitCode=0 Jul 18 00:59:17.124593 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.124533 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" event={"ID":"e6d42561-4e82-4043-8b44-64a73d886025","Type":"ContainerDied","Data":"e53e24750e181a7f0241316868b28574f5f32f79b5f485d8506eb7221ec10aed"} Jul 18 00:59:17.126153 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.126130 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" event={"ID":"86f9b459-2910-4412-a849-f4c79ac4b3cb","Type":"ContainerStarted","Data":"037d3ab48985faf796783ec03ccc6d37b8514495d09c95a03953bc8aeeed03ff"} Jul 18 00:59:17.126264 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.126160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" event={"ID":"86f9b459-2910-4412-a849-f4c79ac4b3cb","Type":"ContainerStarted","Data":"257edca6435a984e40c54982b9e8bb7de9414cc7660c8699fdc2e206c74a5560"} Jul 18 00:59:17.139544 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.139503 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" podStartSLOduration=1.511402177 podStartE2EDuration="5.139487657s" totalImagesPullingTime="3.62808548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:17.137569183 +0000 UTC m=+256.663332859" watchObservedRunningTime="2026-07-18 00:59:17.139487657 +0000 UTC m=+256.665251332" Jul 18 00:59:17.171079 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:17.171007 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-25hf6" podStartSLOduration=2.591565589 podStartE2EDuration="3.170989648s" totalImagesPullingTime="579.424059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:17.169594379 +0000 UTC m=+256.695358057" watchObservedRunningTime="2026-07-18 00:59:17.170989648 +0000 UTC m=+256.696753322" Jul 18 00:59:18.132795 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:18.132760 2556 generic.go:356] "Generic (PLEG): container finished" podID="e6d42561-4e82-4043-8b44-64a73d886025" containerID="b2b19dfefd2ae17e881615e9ff142671896a37fab913cbbb4b3234f3a5a9e928" exitCode=0 Jul 18 00:59:18.133197 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:18.132853 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" event={"ID":"e6d42561-4e82-4043-8b44-64a73d886025","Type":"ContainerDied","Data":"b2b19dfefd2ae17e881615e9ff142671896a37fab913cbbb4b3234f3a5a9e928"} Jul 18 00:59:19.260101 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.260080 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:19.306744 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.306714 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-util\") pod \"e6d42561-4e82-4043-8b44-64a73d886025\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " Jul 18 00:59:19.306898 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.306754 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-bundle\") pod \"e6d42561-4e82-4043-8b44-64a73d886025\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " Jul 18 00:59:19.306898 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.306820 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dcc8\" (UniqueName: \"kubernetes.io/projected/e6d42561-4e82-4043-8b44-64a73d886025-kube-api-access-4dcc8\") pod \"e6d42561-4e82-4043-8b44-64a73d886025\" (UID: \"e6d42561-4e82-4043-8b44-64a73d886025\") " Jul 18 00:59:19.307165 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.307134 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-bundle" (OuterVolumeSpecName: "bundle") pod "e6d42561-4e82-4043-8b44-64a73d886025" (UID: "e6d42561-4e82-4043-8b44-64a73d886025"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:19.309057 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.309030 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6d42561-4e82-4043-8b44-64a73d886025-kube-api-access-4dcc8" (OuterVolumeSpecName: "kube-api-access-4dcc8") pod "e6d42561-4e82-4043-8b44-64a73d886025" (UID: "e6d42561-4e82-4043-8b44-64a73d886025"). InnerVolumeSpecName "kube-api-access-4dcc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:59:19.311222 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.311202 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-util" (OuterVolumeSpecName: "util") pod "e6d42561-4e82-4043-8b44-64a73d886025" (UID: "e6d42561-4e82-4043-8b44-64a73d886025"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:19.407865 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.407783 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dcc8\" (UniqueName: \"kubernetes.io/projected/e6d42561-4e82-4043-8b44-64a73d886025-kube-api-access-4dcc8\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:19.407865 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.407809 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-util\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:19.407865 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:19.407818 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e6d42561-4e82-4043-8b44-64a73d886025-bundle\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:20.142577 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:20.142538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" event={"ID":"e6d42561-4e82-4043-8b44-64a73d886025","Type":"ContainerDied","Data":"7fa71359e499cb932ba61534788aa4e0c3ec1bbde7039a75ce8272fc4be1fb77"} Jul 18 00:59:20.142577 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:20.142562 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdl5w" Jul 18 00:59:20.142577 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:20.142584 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fa71359e499cb932ba61534788aa4e0c3ec1bbde7039a75ce8272fc4be1fb77" Jul 18 00:59:23.134876 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:23.134799 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-k4bmw" Jul 18 00:59:32.373953 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.373919 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm"] Jul 18 00:59:32.374334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.374191 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6d42561-4e82-4043-8b44-64a73d886025" containerName="extract" Jul 18 00:59:32.374334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.374201 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6d42561-4e82-4043-8b44-64a73d886025" containerName="extract" Jul 18 00:59:32.374334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.374217 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6d42561-4e82-4043-8b44-64a73d886025" containerName="pull" Jul 18 00:59:32.374334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.374222 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6d42561-4e82-4043-8b44-64a73d886025" containerName="pull" Jul 18 00:59:32.374334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.374235 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6d42561-4e82-4043-8b44-64a73d886025" containerName="util" Jul 18 00:59:32.374334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.374240 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6d42561-4e82-4043-8b44-64a73d886025" containerName="util" Jul 18 00:59:32.374334 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.374286 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6d42561-4e82-4043-8b44-64a73d886025" containerName="extract" Jul 18 00:59:32.377242 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.377225 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.379543 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.379519 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 18 00:59:32.379656 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.379553 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 18 00:59:32.380312 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.380298 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gw2dj\"" Jul 18 00:59:32.384937 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.384915 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm"] Jul 18 00:59:32.516638 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.516597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8js8h\" (UniqueName: \"kubernetes.io/projected/bfdd71f4-dc35-42ec-8430-f4da0778c75e-kube-api-access-8js8h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.516808 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.516653 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.516808 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.516695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.618093 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.618045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8js8h\" (UniqueName: \"kubernetes.io/projected/bfdd71f4-dc35-42ec-8430-f4da0778c75e-kube-api-access-8js8h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.618264 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.618122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.618264 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.618159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.618598 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.618579 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.618637 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.618599 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.626622 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.626560 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8js8h\" (UniqueName: \"kubernetes.io/projected/bfdd71f4-dc35-42ec-8430-f4da0778c75e-kube-api-access-8js8h\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.687378 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.687324 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:32.819766 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:32.819742 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm"] Jul 18 00:59:32.822231 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:59:32.822209 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdd71f4_dc35_42ec_8430_f4da0778c75e.slice/crio-1ad371a2efe142f71b7f00fb518c13b42283f90e400f24934a2bf2419d914165 WatchSource:0}: Error finding container 1ad371a2efe142f71b7f00fb518c13b42283f90e400f24934a2bf2419d914165: Status 404 returned error can't find the container with id 1ad371a2efe142f71b7f00fb518c13b42283f90e400f24934a2bf2419d914165 Jul 18 00:59:33.196317 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:33.196227 2556 generic.go:356] "Generic (PLEG): container finished" podID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerID="cca6562b43e50bb337db8b4ff040b7136c1cacedd80dd50450f8c073610261c6" exitCode=0 Jul 18 00:59:33.196317 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:33.196271 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" event={"ID":"bfdd71f4-dc35-42ec-8430-f4da0778c75e","Type":"ContainerDied","Data":"cca6562b43e50bb337db8b4ff040b7136c1cacedd80dd50450f8c073610261c6"} Jul 18 00:59:33.196317 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:33.196313 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" event={"ID":"bfdd71f4-dc35-42ec-8430-f4da0778c75e","Type":"ContainerStarted","Data":"1ad371a2efe142f71b7f00fb518c13b42283f90e400f24934a2bf2419d914165"} Jul 18 00:59:34.202978 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:34.202881 2556 generic.go:356] "Generic (PLEG): container finished" podID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerID="da954413b43a50ce5a8b7681297e168b6a0014e37940bef482f6685662c1fd5f" exitCode=0 Jul 18 00:59:34.202978 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:34.202921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" event={"ID":"bfdd71f4-dc35-42ec-8430-f4da0778c75e","Type":"ContainerDied","Data":"da954413b43a50ce5a8b7681297e168b6a0014e37940bef482f6685662c1fd5f"} Jul 18 00:59:35.209205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:35.209175 2556 generic.go:356] "Generic (PLEG): container finished" podID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerID="dd35f33b0607ca1533b86c9fbfc9905380c9d1148f4517ee37b8f7047128467b" exitCode=0 Jul 18 00:59:35.209595 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:35.209259 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" event={"ID":"bfdd71f4-dc35-42ec-8430-f4da0778c75e","Type":"ContainerDied","Data":"dd35f33b0607ca1533b86c9fbfc9905380c9d1148f4517ee37b8f7047128467b"} Jul 18 00:59:36.340944 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.340922 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:36.449433 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.449397 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8js8h\" (UniqueName: \"kubernetes.io/projected/bfdd71f4-dc35-42ec-8430-f4da0778c75e-kube-api-access-8js8h\") pod \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " Jul 18 00:59:36.449603 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.449447 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-bundle\") pod \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " Jul 18 00:59:36.449603 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.449480 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-util\") pod \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\" (UID: \"bfdd71f4-dc35-42ec-8430-f4da0778c75e\") " Jul 18 00:59:36.450240 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.450208 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-bundle" (OuterVolumeSpecName: "bundle") pod "bfdd71f4-dc35-42ec-8430-f4da0778c75e" (UID: "bfdd71f4-dc35-42ec-8430-f4da0778c75e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:36.451624 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.451598 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfdd71f4-dc35-42ec-8430-f4da0778c75e-kube-api-access-8js8h" (OuterVolumeSpecName: "kube-api-access-8js8h") pod "bfdd71f4-dc35-42ec-8430-f4da0778c75e" (UID: "bfdd71f4-dc35-42ec-8430-f4da0778c75e"). InnerVolumeSpecName "kube-api-access-8js8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 00:59:36.455591 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.455475 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-util" (OuterVolumeSpecName: "util") pod "bfdd71f4-dc35-42ec-8430-f4da0778c75e" (UID: "bfdd71f4-dc35-42ec-8430-f4da0778c75e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 00:59:36.550402 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.550319 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8js8h\" (UniqueName: \"kubernetes.io/projected/bfdd71f4-dc35-42ec-8430-f4da0778c75e-kube-api-access-8js8h\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:36.550402 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.550343 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-bundle\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:36.550402 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:36.550352 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bfdd71f4-dc35-42ec-8430-f4da0778c75e-util\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 00:59:37.219033 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:37.218974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" event={"ID":"bfdd71f4-dc35-42ec-8430-f4da0778c75e","Type":"ContainerDied","Data":"1ad371a2efe142f71b7f00fb518c13b42283f90e400f24934a2bf2419d914165"} Jul 18 00:59:37.219033 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:37.219003 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn7ccm" Jul 18 00:59:37.219195 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:37.219070 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ad371a2efe142f71b7f00fb518c13b42283f90e400f24934a2bf2419d914165" Jul 18 00:59:46.518571 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518537 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8"] Jul 18 00:59:46.519205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518835 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerName="extract" Jul 18 00:59:46.519205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518847 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerName="extract" Jul 18 00:59:46.519205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518868 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerName="util" Jul 18 00:59:46.519205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518873 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerName="util" Jul 18 00:59:46.519205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518881 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerName="pull" Jul 18 00:59:46.519205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518886 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerName="pull" Jul 18 00:59:46.519205 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.518947 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfdd71f4-dc35-42ec-8430-f4da0778c75e" containerName="extract" Jul 18 00:59:46.562358 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.562329 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8"] Jul 18 00:59:46.562524 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.562455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.566591 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.566568 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 18 00:59:46.566738 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.566717 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 18 00:59:46.566984 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.566969 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 18 00:59:46.567133 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.567100 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 18 00:59:46.567415 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.567392 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r2kg7\"" Jul 18 00:59:46.637417 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.637375 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-manifests\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.637613 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.637458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-tmp\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.637613 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.637512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmrpv\" (UniqueName: \"kubernetes.io/projected/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-kube-api-access-jmrpv\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.637613 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.637558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.637613 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.637585 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.738321 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.738280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.738506 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.738347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-manifests\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.738506 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.738368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-tmp\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.738506 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.738401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmrpv\" (UniqueName: \"kubernetes.io/projected/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-kube-api-access-jmrpv\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.738506 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.738425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.738767 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.738744 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-manifests\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.740860 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.740838 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-tmp\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.740986 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.740958 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-webhook-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.741067 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.741046 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.747161 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.747135 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmrpv\" (UniqueName: \"kubernetes.io/projected/5eefedc3-ac64-445a-84d3-5d1cb8a6dc45-kube-api-access-jmrpv\") pod \"opendatahub-operator-controller-manager-84fdb8f5f6-bthg8\" (UID: \"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45\") " pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:46.873373 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:46.873333 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:47.037692 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:47.037663 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8"] Jul 18 00:59:47.041065 ip-10-0-133-101 kubenswrapper[2556]: W0718 00:59:47.041034 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eefedc3_ac64_445a_84d3_5d1cb8a6dc45.slice/crio-d551e71001fe72391620aa4474f68a76738c560d4034f80573bbd3ad6d9864b5 WatchSource:0}: Error finding container d551e71001fe72391620aa4474f68a76738c560d4034f80573bbd3ad6d9864b5: Status 404 returned error can't find the container with id d551e71001fe72391620aa4474f68a76738c560d4034f80573bbd3ad6d9864b5 Jul 18 00:59:47.263712 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:47.263614 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" event={"ID":"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45","Type":"ContainerStarted","Data":"d551e71001fe72391620aa4474f68a76738c560d4034f80573bbd3ad6d9864b5"} Jul 18 00:59:50.280853 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:50.280761 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" event={"ID":"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45","Type":"ContainerStarted","Data":"917ddbcc64bd2d0326c58752558985877cb33d2a74e802db54f6b9754fd51c56"} Jul 18 00:59:51.286399 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:51.286365 2556 generic.go:356] "Generic (PLEG): container finished" podID="5eefedc3-ac64-445a-84d3-5d1cb8a6dc45" containerID="917ddbcc64bd2d0326c58752558985877cb33d2a74e802db54f6b9754fd51c56" exitCode=0 Jul 18 00:59:51.286762 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:51.286425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" event={"ID":"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45","Type":"ContainerDied","Data":"917ddbcc64bd2d0326c58752558985877cb33d2a74e802db54f6b9754fd51c56"} Jul 18 00:59:52.293806 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:52.293773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" event={"ID":"5eefedc3-ac64-445a-84d3-5d1cb8a6dc45","Type":"ContainerStarted","Data":"26e60644c42112eaa1dc81c92665231b071b33aaf86eb70c82f4b02d258d01ce"} Jul 18 00:59:52.294315 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:52.293888 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 00:59:52.314626 ip-10-0-133-101 kubenswrapper[2556]: I0718 00:59:52.314572 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" podStartSLOduration=2.000299082 podStartE2EDuration="6.314555665s" totalImagesPullingTime="3.304603593s" totalInitContainerRuntime="1.00965299s" isStatefulPod=false podCreationTimestamp="2026-07-18 00:59:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 00:59:52.313138569 +0000 UTC m=+291.838902255" watchObservedRunningTime="2026-07-18 00:59:52.314555665 +0000 UTC m=+291.840319350" Jul 18 01:00:00.900901 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:00.900873 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 18 01:00:03.300679 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.300649 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84fdb8f5f6-bthg8" Jul 18 01:00:03.591586 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.591502 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx"] Jul 18 01:00:03.594527 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.594511 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.597155 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.597130 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 18 01:00:03.597367 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.597343 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 18 01:00:03.597456 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.597345 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kjlbm\"" Jul 18 01:00:03.597456 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.597395 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 18 01:00:03.597562 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.597468 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 18 01:00:03.597713 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.597696 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 18 01:00:03.602836 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.602816 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx"] Jul 18 01:00:03.682441 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.682405 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/470a6623-77ee-45ea-9715-d7b68ce52563-cert\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.682441 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.682443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/470a6623-77ee-45ea-9715-d7b68ce52563-metrics-cert\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.682666 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.682471 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/470a6623-77ee-45ea-9715-d7b68ce52563-manager-config\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.682666 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.682490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlhrk\" (UniqueName: \"kubernetes.io/projected/470a6623-77ee-45ea-9715-d7b68ce52563-kube-api-access-wlhrk\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.783296 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.783257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/470a6623-77ee-45ea-9715-d7b68ce52563-manager-config\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.783296 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.783298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlhrk\" (UniqueName: \"kubernetes.io/projected/470a6623-77ee-45ea-9715-d7b68ce52563-kube-api-access-wlhrk\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.783563 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.783369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/470a6623-77ee-45ea-9715-d7b68ce52563-cert\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.783563 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.783385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/470a6623-77ee-45ea-9715-d7b68ce52563-metrics-cert\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.783972 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.783950 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/470a6623-77ee-45ea-9715-d7b68ce52563-manager-config\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.785906 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.785878 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/470a6623-77ee-45ea-9715-d7b68ce52563-metrics-cert\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.786077 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.786055 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/470a6623-77ee-45ea-9715-d7b68ce52563-cert\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.792806 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.792782 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlhrk\" (UniqueName: \"kubernetes.io/projected/470a6623-77ee-45ea-9715-d7b68ce52563-kube-api-access-wlhrk\") pod \"lws-controller-manager-fdb947fcf-hrpsx\" (UID: \"470a6623-77ee-45ea-9715-d7b68ce52563\") " pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:03.904693 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:03.904636 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:04.036051 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:04.035994 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx"] Jul 18 01:00:04.039572 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:00:04.039546 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470a6623_77ee_45ea_9715_d7b68ce52563.slice/crio-84d82c9ce8ac2e050b9cfe192644bdee4abac32b4932e58b59d0da6d07a777fa WatchSource:0}: Error finding container 84d82c9ce8ac2e050b9cfe192644bdee4abac32b4932e58b59d0da6d07a777fa: Status 404 returned error can't find the container with id 84d82c9ce8ac2e050b9cfe192644bdee4abac32b4932e58b59d0da6d07a777fa Jul 18 01:00:04.041625 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:04.041608 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 18 01:00:04.350241 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:04.350208 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" event={"ID":"470a6623-77ee-45ea-9715-d7b68ce52563","Type":"ContainerStarted","Data":"84d82c9ce8ac2e050b9cfe192644bdee4abac32b4932e58b59d0da6d07a777fa"} Jul 18 01:00:08.369875 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:08.369833 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" event={"ID":"470a6623-77ee-45ea-9715-d7b68ce52563","Type":"ContainerStarted","Data":"d2783e20103a9f886bcb52c968bc19a6c8dcb78fd7de1be5772de1a6be6097bc"} Jul 18 01:00:08.370292 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:08.369977 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:08.385801 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:08.385747 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" podStartSLOduration=1.379473333 podStartE2EDuration="5.385729349s" totalImagesPullingTime="4.006256016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:08.384836976 +0000 UTC m=+307.910600671" watchObservedRunningTime="2026-07-18 01:00:08.385729349 +0000 UTC m=+307.911493023" Jul 18 01:00:14.162577 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.162538 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5"] Jul 18 01:00:14.166843 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.166821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.171239 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.171213 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 18 01:00:14.172042 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.172007 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 18 01:00:14.172194 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.172081 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 18 01:00:14.172335 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.172118 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 18 01:00:14.176228 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.176210 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 18 01:00:14.177461 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.177443 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 18 01:00:14.177552 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.177460 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vg7kb\"" Jul 18 01:00:14.190832 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.190803 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5"] Jul 18 01:00:14.276709 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.276676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.276709 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.276718 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.276962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.276792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a6f38f-262d-495f-9723-646c5441582a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.276962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.276814 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.276962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.276840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5ms6\" (UniqueName: \"kubernetes.io/projected/63a6f38f-262d-495f-9723-646c5441582a-kube-api-access-p5ms6\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.276962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.276871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63a6f38f-262d-495f-9723-646c5441582a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.276962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.276912 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a6f38f-262d-495f-9723-646c5441582a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.377966 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.377926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.378193 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.377974 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.378193 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.378060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a6f38f-262d-495f-9723-646c5441582a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.378193 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.378094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.378193 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.378117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5ms6\" (UniqueName: \"kubernetes.io/projected/63a6f38f-262d-495f-9723-646c5441582a-kube-api-access-p5ms6\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.378193 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.378156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63a6f38f-262d-495f-9723-646c5441582a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.378193 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.378185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a6f38f-262d-495f-9723-646c5441582a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.379032 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.378994 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/63a6f38f-262d-495f-9723-646c5441582a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.380641 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.380618 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/63a6f38f-262d-495f-9723-646c5441582a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.380738 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.380646 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.380738 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.380674 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.380852 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.380830 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/63a6f38f-262d-495f-9723-646c5441582a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.386242 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.386220 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63a6f38f-262d-495f-9723-646c5441582a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.386449 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.386431 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5ms6\" (UniqueName: \"kubernetes.io/projected/63a6f38f-262d-495f-9723-646c5441582a-kube-api-access-p5ms6\") pod \"istiod-openshift-gateway-94bb8fbfd-tlbs5\" (UID: \"63a6f38f-262d-495f-9723-646c5441582a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.475832 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.475739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:14.615389 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:14.615350 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5"] Jul 18 01:00:14.619936 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:00:14.619909 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a6f38f_262d_495f_9723_646c5441582a.slice/crio-37cfcd09c9f5b893cd0602aebd9a8dfbcf106bce15e762640d1822438daf7b45 WatchSource:0}: Error finding container 37cfcd09c9f5b893cd0602aebd9a8dfbcf106bce15e762640d1822438daf7b45: Status 404 returned error can't find the container with id 37cfcd09c9f5b893cd0602aebd9a8dfbcf106bce15e762640d1822438daf7b45 Jul 18 01:00:15.404731 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:15.404698 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" event={"ID":"63a6f38f-262d-495f-9723-646c5441582a","Type":"ContainerStarted","Data":"37cfcd09c9f5b893cd0602aebd9a8dfbcf106bce15e762640d1822438daf7b45"} Jul 18 01:00:17.447360 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:17.447324 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:17.447747 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:17.447406 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:17.943363 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:17.943320 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s"] Jul 18 01:00:17.947302 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:17.947273 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:17.953946 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:17.953913 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9tgfd\"" Jul 18 01:00:17.968798 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:17.968767 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s"] Jul 18 01:00:18.011758 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.011696 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.011758 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.011750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.012130 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.011821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.012130 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.011864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.012130 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.011906 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.012130 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.011928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q58d\" (UniqueName: \"kubernetes.io/projected/72128a42-1c6f-4cde-b0fe-d635a73cb47b-kube-api-access-7q58d\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.012130 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.011957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.012130 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.012004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.012130 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.012076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113299 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113258 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113504 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113504 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113504 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113504 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113708 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113708 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113708 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q58d\" (UniqueName: \"kubernetes.io/projected/72128a42-1c6f-4cde-b0fe-d635a73cb47b-kube-api-access-7q58d\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113708 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113676 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113708 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113695 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113753 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.113962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113822 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.114096 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.113991 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.114781 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.114755 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.115903 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.115883 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.116660 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.116621 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.123693 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.123664 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q58d\" (UniqueName: \"kubernetes.io/projected/72128a42-1c6f-4cde-b0fe-d635a73cb47b-kube-api-access-7q58d\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.123862 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.123842 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72128a42-1c6f-4cde-b0fe-d635a73cb47b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678sqc8s\" (UID: \"72128a42-1c6f-4cde-b0fe-d635a73cb47b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.260743 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.260658 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:18.419936 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.419903 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" event={"ID":"63a6f38f-262d-495f-9723-646c5441582a","Type":"ContainerStarted","Data":"e8cc8d6c11a84cf57195dbb954b0715c6c88c1038c0caec13488a41a51549124"} Jul 18 01:00:18.420156 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.420137 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:18.421598 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.421569 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-tlbs5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 18 01:00:18.421713 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.421621 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" podUID="63a6f38f-262d-495f-9723-646c5441582a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 18 01:00:18.429897 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.429874 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s"] Jul 18 01:00:18.431543 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:00:18.431516 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72128a42_1c6f_4cde_b0fe_d635a73cb47b.slice/crio-0f2e5c1ba19f1898b0f25e51cf9be30d6e07a3ce507947c41c21609f057283b6 WatchSource:0}: Error finding container 0f2e5c1ba19f1898b0f25e51cf9be30d6e07a3ce507947c41c21609f057283b6: Status 404 returned error can't find the container with id 0f2e5c1ba19f1898b0f25e51cf9be30d6e07a3ce507947c41c21609f057283b6 Jul 18 01:00:18.449996 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:18.449939 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" podStartSLOduration=1.62505082 podStartE2EDuration="4.449920549s" totalImagesPullingTime="2.824869729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:18.448916819 +0000 UTC m=+317.974680538" watchObservedRunningTime="2026-07-18 01:00:18.449920549 +0000 UTC m=+317.975684225" Jul 18 01:00:19.378682 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:19.378652 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-fdb947fcf-hrpsx" Jul 18 01:00:19.428779 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:19.428746 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" event={"ID":"72128a42-1c6f-4cde-b0fe-d635a73cb47b","Type":"ContainerStarted","Data":"0f2e5c1ba19f1898b0f25e51cf9be30d6e07a3ce507947c41c21609f057283b6"} Jul 18 01:00:19.429672 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:19.429648 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-tlbs5" Jul 18 01:00:21.143800 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:21.143760 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:21.144122 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:21.143832 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:21.144122 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:21.143862 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:00:21.439849 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:21.439764 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" event={"ID":"72128a42-1c6f-4cde-b0fe-d635a73cb47b","Type":"ContainerStarted","Data":"b0fe3187283d94cc999a3512d7a00dd4130a66b74ae19fa651289c4eea3cb30e"} Jul 18 01:00:21.462882 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:21.462831 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" podStartSLOduration=1.7529284710000002 podStartE2EDuration="4.462811832s" totalImagesPullingTime="2.709883361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:00:21.46162668 +0000 UTC m=+320.987390381" watchObservedRunningTime="2026-07-18 01:00:21.462811832 +0000 UTC m=+320.988575508" Jul 18 01:00:22.261757 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:22.261716 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:22.266405 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:22.266383 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:22.444052 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:22.444007 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:00:22.444882 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:00:22.444862 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678sqc8s" Jul 18 01:01:22.905274 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.905239 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst"] Jul 18 01:01:22.907435 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.907418 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:22.909648 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.909629 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 01:01:22.909734 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.909655 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hdcgr\"" Jul 18 01:01:22.910512 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.910495 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 01:01:22.915732 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.915709 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst"] Jul 18 01:01:22.971865 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.971830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:22.972081 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.971884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkwcq\" (UniqueName: \"kubernetes.io/projected/93c7a470-9460-4b2e-a51c-17d12e4f264a-kube-api-access-xkwcq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:22.972081 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:22.971920 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.072828 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.072792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.073000 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.072853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.073000 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.072896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkwcq\" (UniqueName: \"kubernetes.io/projected/93c7a470-9460-4b2e-a51c-17d12e4f264a-kube-api-access-xkwcq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.073222 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.073202 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.073280 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.073259 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.081972 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.081944 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkwcq\" (UniqueName: \"kubernetes.io/projected/93c7a470-9460-4b2e-a51c-17d12e4f264a-kube-api-access-xkwcq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.217398 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.217318 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:23.348516 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.348493 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst"] Jul 18 01:01:23.351121 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:01:23.351093 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c7a470_9460_4b2e_a51c_17d12e4f264a.slice/crio-03dc4e7b29bbecb263c12045ad7b952b8745beadf94d1644bc42946d1d2efb16 WatchSource:0}: Error finding container 03dc4e7b29bbecb263c12045ad7b952b8745beadf94d1644bc42946d1d2efb16: Status 404 returned error can't find the container with id 03dc4e7b29bbecb263c12045ad7b952b8745beadf94d1644bc42946d1d2efb16 Jul 18 01:01:23.501335 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.501251 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj"] Jul 18 01:01:23.503816 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.503800 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.511651 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.511631 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj"] Jul 18 01:01:23.577940 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.577902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.578131 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.577959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sp6g\" (UniqueName: \"kubernetes.io/projected/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-kube-api-access-2sp6g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.578131 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.577988 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.678901 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.678857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sp6g\" (UniqueName: \"kubernetes.io/projected/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-kube-api-access-2sp6g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.679099 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.678920 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.679099 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.678988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.679378 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.679357 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.679427 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.679410 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.687159 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.687131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sp6g\" (UniqueName: \"kubernetes.io/projected/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-kube-api-access-2sp6g\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.728273 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.728240 2556 generic.go:356] "Generic (PLEG): container finished" podID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerID="ee9aaf0bda7af9c02051656385b98cb2707797489b37a880b31f960da6545902" exitCode=0 Jul 18 01:01:23.728429 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.728315 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" event={"ID":"93c7a470-9460-4b2e-a51c-17d12e4f264a","Type":"ContainerDied","Data":"ee9aaf0bda7af9c02051656385b98cb2707797489b37a880b31f960da6545902"} Jul 18 01:01:23.728429 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.728353 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" event={"ID":"93c7a470-9460-4b2e-a51c-17d12e4f264a","Type":"ContainerStarted","Data":"03dc4e7b29bbecb263c12045ad7b952b8745beadf94d1644bc42946d1d2efb16"} Jul 18 01:01:23.813379 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.813292 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:23.943906 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:23.943882 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj"] Jul 18 01:01:23.945743 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:01:23.945717 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd042e82d_b6f7_42cb_ad13_39fb6c20cdc9.slice/crio-a2a3a0c8421319968a580a957412da48a2e8e4be76728a69552c542bd3cdfbf3 WatchSource:0}: Error finding container a2a3a0c8421319968a580a957412da48a2e8e4be76728a69552c542bd3cdfbf3: Status 404 returned error can't find the container with id a2a3a0c8421319968a580a957412da48a2e8e4be76728a69552c542bd3cdfbf3 Jul 18 01:01:24.101345 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.101308 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z"] Jul 18 01:01:24.104041 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.104008 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.112077 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.112047 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z"] Jul 18 01:01:24.184196 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.184159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx955\" (UniqueName: \"kubernetes.io/projected/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-kube-api-access-nx955\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.184368 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.184269 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.184368 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.184301 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.285389 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.285350 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx955\" (UniqueName: \"kubernetes.io/projected/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-kube-api-access-nx955\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.285556 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.285439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.285556 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.285462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.285787 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.285771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.285846 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.285828 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.293828 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.293800 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx955\" (UniqueName: \"kubernetes.io/projected/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-kube-api-access-nx955\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.412996 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.412966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:24.509431 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.509400 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b"] Jul 18 01:01:24.513275 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.513250 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.519366 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.519346 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b"] Jul 18 01:01:24.585252 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.585230 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z"] Jul 18 01:01:24.587077 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:01:24.587009 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca1d201_80d5_4df9_aa51_cd4fab0ea09d.slice/crio-3e0c378a59ab98341a0cdf107ed8c185fa81d581ef928313e1a6e253a2f46efc WatchSource:0}: Error finding container 3e0c378a59ab98341a0cdf107ed8c185fa81d581ef928313e1a6e253a2f46efc: Status 404 returned error can't find the container with id 3e0c378a59ab98341a0cdf107ed8c185fa81d581ef928313e1a6e253a2f46efc Jul 18 01:01:24.587077 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.587008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9lw5\" (UniqueName: \"kubernetes.io/projected/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-kube-api-access-r9lw5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.587240 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.587159 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.587240 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.587229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.688428 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.688388 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.688587 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.688462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9lw5\" (UniqueName: \"kubernetes.io/projected/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-kube-api-access-r9lw5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.688587 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.688520 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.688765 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.688739 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.688837 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.688814 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.699876 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.699847 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9lw5\" (UniqueName: \"kubernetes.io/projected/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-kube-api-access-r9lw5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.735415 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.735377 2556 generic.go:356] "Generic (PLEG): container finished" podID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerID="d6791319520c5cf858d685a17b80a84de3185d10baee6fe8b5d621636523d624" exitCode=0 Jul 18 01:01:24.735593 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.735470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" event={"ID":"93c7a470-9460-4b2e-a51c-17d12e4f264a","Type":"ContainerDied","Data":"d6791319520c5cf858d685a17b80a84de3185d10baee6fe8b5d621636523d624"} Jul 18 01:01:24.737170 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.737043 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" event={"ID":"bca1d201-80d5-4df9-aa51-cd4fab0ea09d","Type":"ContainerStarted","Data":"f70fadf9d29ab5a00ae1bc2675ea155c35fd0ac16327c9df262e4f257eefe925"} Jul 18 01:01:24.737170 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.737090 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" event={"ID":"bca1d201-80d5-4df9-aa51-cd4fab0ea09d","Type":"ContainerStarted","Data":"3e0c378a59ab98341a0cdf107ed8c185fa81d581ef928313e1a6e253a2f46efc"} Jul 18 01:01:24.738743 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.738711 2556 generic.go:356] "Generic (PLEG): container finished" podID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerID="cdaa5a2cca9d6111501c5c3d5522db3c386de8b503c191e7adfbc8332bf3152f" exitCode=0 Jul 18 01:01:24.738846 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.738755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" event={"ID":"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9","Type":"ContainerDied","Data":"cdaa5a2cca9d6111501c5c3d5522db3c386de8b503c191e7adfbc8332bf3152f"} Jul 18 01:01:24.738846 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.738806 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" event={"ID":"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9","Type":"ContainerStarted","Data":"a2a3a0c8421319968a580a957412da48a2e8e4be76728a69552c542bd3cdfbf3"} Jul 18 01:01:24.856666 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.856633 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:24.990911 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:24.990888 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b"] Jul 18 01:01:24.992864 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:01:24.992840 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae727cb_2cb5_4e02_82bd_6ac4d41719e9.slice/crio-086a14bf2624956957cf8a66fd17dc190713c91c3bf24e1f63a7e0f0bbe8b950 WatchSource:0}: Error finding container 086a14bf2624956957cf8a66fd17dc190713c91c3bf24e1f63a7e0f0bbe8b950: Status 404 returned error can't find the container with id 086a14bf2624956957cf8a66fd17dc190713c91c3bf24e1f63a7e0f0bbe8b950 Jul 18 01:01:25.745468 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.745436 2556 generic.go:356] "Generic (PLEG): container finished" podID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerID="634cb0c3189acc1780b1b8c08372bb724cc2c1277d24b44fa4a7631966228c0e" exitCode=0 Jul 18 01:01:25.745665 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.745524 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" event={"ID":"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9","Type":"ContainerDied","Data":"634cb0c3189acc1780b1b8c08372bb724cc2c1277d24b44fa4a7631966228c0e"} Jul 18 01:01:25.747749 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.747728 2556 generic.go:356] "Generic (PLEG): container finished" podID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerID="64ce200ff47bfa922be3c45554d83c54c913f946b094e40748b1d9a5ade8aab1" exitCode=0 Jul 18 01:01:25.747851 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.747793 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" event={"ID":"93c7a470-9460-4b2e-a51c-17d12e4f264a","Type":"ContainerDied","Data":"64ce200ff47bfa922be3c45554d83c54c913f946b094e40748b1d9a5ade8aab1"} Jul 18 01:01:25.749189 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.749166 2556 generic.go:356] "Generic (PLEG): container finished" podID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerID="f70fadf9d29ab5a00ae1bc2675ea155c35fd0ac16327c9df262e4f257eefe925" exitCode=0 Jul 18 01:01:25.749288 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.749245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" event={"ID":"bca1d201-80d5-4df9-aa51-cd4fab0ea09d","Type":"ContainerDied","Data":"f70fadf9d29ab5a00ae1bc2675ea155c35fd0ac16327c9df262e4f257eefe925"} Jul 18 01:01:25.750857 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.750835 2556 generic.go:356] "Generic (PLEG): container finished" podID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerID="fb66fef84df32570f245676d131023ea475f8687252f92123a8427cc0dadebcf" exitCode=0 Jul 18 01:01:25.750927 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.750900 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" event={"ID":"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9","Type":"ContainerDied","Data":"fb66fef84df32570f245676d131023ea475f8687252f92123a8427cc0dadebcf"} Jul 18 01:01:25.750976 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:25.750934 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" event={"ID":"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9","Type":"ContainerStarted","Data":"086a14bf2624956957cf8a66fd17dc190713c91c3bf24e1f63a7e0f0bbe8b950"} Jul 18 01:01:26.757904 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:26.757876 2556 generic.go:356] "Generic (PLEG): container finished" podID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerID="a008b2098a3846427f31741eb4c5a6b493c4451f0811609750eec93e6f23a23b" exitCode=0 Jul 18 01:01:26.758295 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:26.757962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" event={"ID":"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9","Type":"ContainerDied","Data":"a008b2098a3846427f31741eb4c5a6b493c4451f0811609750eec93e6f23a23b"} Jul 18 01:01:26.760070 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:26.760040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" event={"ID":"bca1d201-80d5-4df9-aa51-cd4fab0ea09d","Type":"ContainerStarted","Data":"355358f5f975233dcd64cbcf14fef7ea288dc777702e31de22b3c8efbbc25a77"} Jul 18 01:01:26.889509 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:26.889483 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:27.009497 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.009458 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-bundle\") pod \"93c7a470-9460-4b2e-a51c-17d12e4f264a\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " Jul 18 01:01:27.009637 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.009518 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-util\") pod \"93c7a470-9460-4b2e-a51c-17d12e4f264a\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " Jul 18 01:01:27.009637 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.009561 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkwcq\" (UniqueName: \"kubernetes.io/projected/93c7a470-9460-4b2e-a51c-17d12e4f264a-kube-api-access-xkwcq\") pod \"93c7a470-9460-4b2e-a51c-17d12e4f264a\" (UID: \"93c7a470-9460-4b2e-a51c-17d12e4f264a\") " Jul 18 01:01:27.010188 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.010146 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-bundle" (OuterVolumeSpecName: "bundle") pod "93c7a470-9460-4b2e-a51c-17d12e4f264a" (UID: "93c7a470-9460-4b2e-a51c-17d12e4f264a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:27.011965 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.011938 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c7a470-9460-4b2e-a51c-17d12e4f264a-kube-api-access-xkwcq" (OuterVolumeSpecName: "kube-api-access-xkwcq") pod "93c7a470-9460-4b2e-a51c-17d12e4f264a" (UID: "93c7a470-9460-4b2e-a51c-17d12e4f264a"). InnerVolumeSpecName "kube-api-access-xkwcq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:01:27.015590 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.015566 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-util" (OuterVolumeSpecName: "util") pod "93c7a470-9460-4b2e-a51c-17d12e4f264a" (UID: "93c7a470-9460-4b2e-a51c-17d12e4f264a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:27.111175 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.111140 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkwcq\" (UniqueName: \"kubernetes.io/projected/93c7a470-9460-4b2e-a51c-17d12e4f264a-kube-api-access-xkwcq\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:27.111175 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.111168 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-bundle\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:27.111175 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.111178 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/93c7a470-9460-4b2e-a51c-17d12e4f264a-util\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:27.767146 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.767120 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" Jul 18 01:01:27.767577 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.767117 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst" event={"ID":"93c7a470-9460-4b2e-a51c-17d12e4f264a","Type":"ContainerDied","Data":"03dc4e7b29bbecb263c12045ad7b952b8745beadf94d1644bc42946d1d2efb16"} Jul 18 01:01:27.767577 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.767239 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03dc4e7b29bbecb263c12045ad7b952b8745beadf94d1644bc42946d1d2efb16" Jul 18 01:01:27.768910 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.768886 2556 generic.go:356] "Generic (PLEG): container finished" podID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerID="355358f5f975233dcd64cbcf14fef7ea288dc777702e31de22b3c8efbbc25a77" exitCode=0 Jul 18 01:01:27.769048 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.768965 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" event={"ID":"bca1d201-80d5-4df9-aa51-cd4fab0ea09d","Type":"ContainerDied","Data":"355358f5f975233dcd64cbcf14fef7ea288dc777702e31de22b3c8efbbc25a77"} Jul 18 01:01:27.770923 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.770902 2556 generic.go:356] "Generic (PLEG): container finished" podID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerID="99f3c4ab25387d2f1d2b622c0896fe2d24999824dbed8f5cfeb9788b5f18671e" exitCode=0 Jul 18 01:01:27.771036 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.770980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" event={"ID":"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9","Type":"ContainerDied","Data":"99f3c4ab25387d2f1d2b622c0896fe2d24999824dbed8f5cfeb9788b5f18671e"} Jul 18 01:01:27.921942 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:27.921910 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:28.020316 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.020232 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-bundle\") pod \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " Jul 18 01:01:28.020316 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.020268 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-util\") pod \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " Jul 18 01:01:28.020316 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.020314 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sp6g\" (UniqueName: \"kubernetes.io/projected/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-kube-api-access-2sp6g\") pod \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\" (UID: \"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9\") " Jul 18 01:01:28.020762 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.020734 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-bundle" (OuterVolumeSpecName: "bundle") pod "d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" (UID: "d042e82d-b6f7-42cb-ad13-39fb6c20cdc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:28.022630 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.022609 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-kube-api-access-2sp6g" (OuterVolumeSpecName: "kube-api-access-2sp6g") pod "d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" (UID: "d042e82d-b6f7-42cb-ad13-39fb6c20cdc9"). InnerVolumeSpecName "kube-api-access-2sp6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:01:28.024972 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.024951 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-util" (OuterVolumeSpecName: "util") pod "d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" (UID: "d042e82d-b6f7-42cb-ad13-39fb6c20cdc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:28.121400 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.121358 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-bundle\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:28.121400 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.121391 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-util\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:28.121400 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.121403 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sp6g\" (UniqueName: \"kubernetes.io/projected/d042e82d-b6f7-42cb-ad13-39fb6c20cdc9-kube-api-access-2sp6g\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:28.778096 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.778065 2556 generic.go:356] "Generic (PLEG): container finished" podID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerID="0bdf086d81b853e0291c9a1c7ae5919fe301f1748e207099c488234b7c02ebf4" exitCode=0 Jul 18 01:01:28.778588 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.778149 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" event={"ID":"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9","Type":"ContainerDied","Data":"0bdf086d81b853e0291c9a1c7ae5919fe301f1748e207099c488234b7c02ebf4"} Jul 18 01:01:28.780001 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.779984 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" Jul 18 01:01:28.780101 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.780007 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj" event={"ID":"d042e82d-b6f7-42cb-ad13-39fb6c20cdc9","Type":"ContainerDied","Data":"a2a3a0c8421319968a580a957412da48a2e8e4be76728a69552c542bd3cdfbf3"} Jul 18 01:01:28.780101 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.780065 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2a3a0c8421319968a580a957412da48a2e8e4be76728a69552c542bd3cdfbf3" Jul 18 01:01:28.782180 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.782150 2556 generic.go:356] "Generic (PLEG): container finished" podID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerID="aa90ba005976d4fc2ade0e3f25a41604be3391c8ba6593af77d763847ecaa541" exitCode=0 Jul 18 01:01:28.782290 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:28.782189 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" event={"ID":"bca1d201-80d5-4df9-aa51-cd4fab0ea09d","Type":"ContainerDied","Data":"aa90ba005976d4fc2ade0e3f25a41604be3391c8ba6593af77d763847ecaa541"} Jul 18 01:01:29.922651 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:29.922617 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:29.958489 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:29.958461 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:01:30.037120 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037083 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-bundle\") pod \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " Jul 18 01:01:30.037261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037136 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-util\") pod \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " Jul 18 01:01:30.037261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037165 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx955\" (UniqueName: \"kubernetes.io/projected/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-kube-api-access-nx955\") pod \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " Jul 18 01:01:30.037261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037186 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9lw5\" (UniqueName: \"kubernetes.io/projected/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-kube-api-access-r9lw5\") pod \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " Jul 18 01:01:30.037261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037222 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-util\") pod \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\" (UID: \"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9\") " Jul 18 01:01:30.037455 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037265 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-bundle\") pod \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\" (UID: \"bca1d201-80d5-4df9-aa51-cd4fab0ea09d\") " Jul 18 01:01:30.037907 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037822 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-bundle" (OuterVolumeSpecName: "bundle") pod "bca1d201-80d5-4df9-aa51-cd4fab0ea09d" (UID: "bca1d201-80d5-4df9-aa51-cd4fab0ea09d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:30.037907 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.037828 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-bundle" (OuterVolumeSpecName: "bundle") pod "5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" (UID: "5ae727cb-2cb5-4e02-82bd-6ac4d41719e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:30.039485 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.039462 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-kube-api-access-r9lw5" (OuterVolumeSpecName: "kube-api-access-r9lw5") pod "5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" (UID: "5ae727cb-2cb5-4e02-82bd-6ac4d41719e9"). InnerVolumeSpecName "kube-api-access-r9lw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:01:30.039562 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.039523 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-kube-api-access-nx955" (OuterVolumeSpecName: "kube-api-access-nx955") pod "bca1d201-80d5-4df9-aa51-cd4fab0ea09d" (UID: "bca1d201-80d5-4df9-aa51-cd4fab0ea09d"). InnerVolumeSpecName "kube-api-access-nx955". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:01:30.044773 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.044728 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-util" (OuterVolumeSpecName: "util") pod "bca1d201-80d5-4df9-aa51-cd4fab0ea09d" (UID: "bca1d201-80d5-4df9-aa51-cd4fab0ea09d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:30.045373 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.045351 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-util" (OuterVolumeSpecName: "util") pod "5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" (UID: "5ae727cb-2cb5-4e02-82bd-6ac4d41719e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:01:30.138259 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.138202 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-util\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:30.138259 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.138259 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx955\" (UniqueName: \"kubernetes.io/projected/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-kube-api-access-nx955\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:30.138259 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.138275 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9lw5\" (UniqueName: \"kubernetes.io/projected/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-kube-api-access-r9lw5\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:30.138539 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.138288 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-util\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:30.138539 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.138301 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bca1d201-80d5-4df9-aa51-cd4fab0ea09d-bundle\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:30.138539 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.138312 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ae727cb-2cb5-4e02-82bd-6ac4d41719e9-bundle\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:01:30.795323 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.795292 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" Jul 18 01:01:30.795512 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.795326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b" event={"ID":"5ae727cb-2cb5-4e02-82bd-6ac4d41719e9","Type":"ContainerDied","Data":"086a14bf2624956957cf8a66fd17dc190713c91c3bf24e1f63a7e0f0bbe8b950"} Jul 18 01:01:30.795512 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.795383 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="086a14bf2624956957cf8a66fd17dc190713c91c3bf24e1f63a7e0f0bbe8b950" Jul 18 01:01:30.797137 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.797106 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" event={"ID":"bca1d201-80d5-4df9-aa51-cd4fab0ea09d","Type":"ContainerDied","Data":"3e0c378a59ab98341a0cdf107ed8c185fa81d581ef928313e1a6e253a2f46efc"} Jul 18 01:01:30.797256 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.797149 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e0c378a59ab98341a0cdf107ed8c185fa81d581ef928313e1a6e253a2f46efc" Jul 18 01:01:30.797256 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:01:30.797150 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z" Jul 18 01:02:09.688667 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688635 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp"] Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688942 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688952 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688960 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688965 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688978 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688983 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688991 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.688996 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689006 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689011 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689051 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689058 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689067 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689074 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689084 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689089 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689097 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689101 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689106 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689111 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerName="pull" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689115 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689121 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689127 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689133 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerName="util" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689188 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d042e82d-b6f7-42cb-ad13-39fb6c20cdc9" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689198 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c7a470-9460-4b2e-a51c-17d12e4f264a" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689205 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bca1d201-80d5-4df9-aa51-cd4fab0ea09d" containerName="extract" Jul 18 01:02:09.689231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.689211 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae727cb-2cb5-4e02-82bd-6ac4d41719e9" containerName="extract" Jul 18 01:02:09.692386 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.692364 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" Jul 18 01:02:09.695030 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.694992 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 18 01:02:09.695866 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.695847 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w247v\"" Jul 18 01:02:09.695866 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.695858 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 18 01:02:09.703828 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.703802 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp"] Jul 18 01:02:09.770436 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.770402 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qsz2\" (UniqueName: \"kubernetes.io/projected/fc6f8e2d-1f1b-4443-9d42-4611e90cc20b-kube-api-access-8qsz2\") pod \"limitador-operator-controller-manager-859d7b78bd-lx7wp\" (UID: \"fc6f8e2d-1f1b-4443-9d42-4611e90cc20b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" Jul 18 01:02:09.871278 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.871237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qsz2\" (UniqueName: \"kubernetes.io/projected/fc6f8e2d-1f1b-4443-9d42-4611e90cc20b-kube-api-access-8qsz2\") pod \"limitador-operator-controller-manager-859d7b78bd-lx7wp\" (UID: \"fc6f8e2d-1f1b-4443-9d42-4611e90cc20b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" Jul 18 01:02:09.880848 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:09.880817 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qsz2\" (UniqueName: \"kubernetes.io/projected/fc6f8e2d-1f1b-4443-9d42-4611e90cc20b-kube-api-access-8qsz2\") pod \"limitador-operator-controller-manager-859d7b78bd-lx7wp\" (UID: \"fc6f8e2d-1f1b-4443-9d42-4611e90cc20b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" Jul 18 01:02:10.004499 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:10.004414 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" Jul 18 01:02:10.156507 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:10.156482 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp"] Jul 18 01:02:10.159240 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:02:10.159216 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6f8e2d_1f1b_4443_9d42_4611e90cc20b.slice/crio-ecf909e1e4a610cd8e31af2ed8c658f274c49f34bb2817ee4bd0176569182ac0 WatchSource:0}: Error finding container ecf909e1e4a610cd8e31af2ed8c658f274c49f34bb2817ee4bd0176569182ac0: Status 404 returned error can't find the container with id ecf909e1e4a610cd8e31af2ed8c658f274c49f34bb2817ee4bd0176569182ac0 Jul 18 01:02:10.987321 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:10.987282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" event={"ID":"fc6f8e2d-1f1b-4443-9d42-4611e90cc20b","Type":"ContainerStarted","Data":"ecf909e1e4a610cd8e31af2ed8c658f274c49f34bb2817ee4bd0176569182ac0"} Jul 18 01:02:12.999074 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:12.999042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" event={"ID":"fc6f8e2d-1f1b-4443-9d42-4611e90cc20b","Type":"ContainerStarted","Data":"27bbe268df623d2140ea21cda78a358af0a911fa545f47e3c2c9f3eb49dbd379"} Jul 18 01:02:12.999474 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:12.999144 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" Jul 18 01:02:13.018541 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:13.018490 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" podStartSLOduration=2.144065989 podStartE2EDuration="4.018474397s" totalImagesPullingTime="1.874408408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:02:13.017243381 +0000 UTC m=+432.543007066" watchObservedRunningTime="2026-07-18 01:02:13.018474397 +0000 UTC m=+432.544238072" Jul 18 01:02:24.008004 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:02:24.007932 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-lx7wp" Jul 18 01:04:43.360192 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.360158 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-65z55"] Jul 18 01:04:43.364242 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.364212 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.367483 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.367457 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wwm57\"" Jul 18 01:04:43.367977 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.367959 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 18 01:04:43.368107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.368030 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 18 01:04:43.368107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.368099 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 18 01:04:43.373372 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.373345 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-65z55"] Jul 18 01:04:43.388616 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.388586 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m9mq\" (UniqueName: \"kubernetes.io/projected/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-kube-api-access-5m9mq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.388777 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.388630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.388777 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.388694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.388777 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.388746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.388885 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.388776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.388885 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.388827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490088 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490292 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490131 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m9mq\" (UniqueName: \"kubernetes.io/projected/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-kube-api-access-5m9mq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490292 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490292 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490206 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490458 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490458 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490570 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490492 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490570 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.490819 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.490795 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.492729 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.492699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.492858 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.492841 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.504524 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.504498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m9mq\" (UniqueName: \"kubernetes.io/projected/cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f-kube-api-access-5m9mq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-65z55\" (UID: \"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.677121 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.677001 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:43.816989 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:43.816964 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-65z55"] Jul 18 01:04:43.818749 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:04:43.818727 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7cf1d5_347f_4970_9b9d_a9d6f1c27f4f.slice/crio-41299a5fdbc1584a48b5543b4e6712234741a09360072875bcc4a64c7bd27e41 WatchSource:0}: Error finding container 41299a5fdbc1584a48b5543b4e6712234741a09360072875bcc4a64c7bd27e41: Status 404 returned error can't find the container with id 41299a5fdbc1584a48b5543b4e6712234741a09360072875bcc4a64c7bd27e41 Jul 18 01:04:44.739665 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:44.739621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" event={"ID":"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f","Type":"ContainerStarted","Data":"41299a5fdbc1584a48b5543b4e6712234741a09360072875bcc4a64c7bd27e41"} Jul 18 01:04:45.746038 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:45.745980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" event={"ID":"cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f","Type":"ContainerStarted","Data":"3df2aea98ff2431ed0e412a2f22bec1e90ca2af27b06cba6a92cda470070e976"} Jul 18 01:04:45.770374 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:45.770321 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" podStartSLOduration=1.764071442 podStartE2EDuration="2.770305303s" totalImagesPullingTime="1.006233861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:04:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:04:45.767762527 +0000 UTC m=+585.293526196" watchObservedRunningTime="2026-07-18 01:04:45.770305303 +0000 UTC m=+585.296068977" Jul 18 01:04:53.677535 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:53.677496 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:53.677983 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:53.677642 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:53.690254 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:53.690230 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:04:53.796257 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:04:53.796233 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-65z55" Jul 18 01:05:01.370351 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.370313 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn"] Jul 18 01:05:01.373899 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.373882 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.376556 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.376534 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 18 01:05:01.384514 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.384489 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn"] Jul 18 01:05:01.459754 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.459710 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.459754 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.459754 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.459977 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.459790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0255c61-df1b-412e-917d-6fd85ffcedb2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.459977 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.459854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.459977 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.459892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5l2k\" (UniqueName: \"kubernetes.io/projected/b0255c61-df1b-412e-917d-6fd85ffcedb2-kube-api-access-j5l2k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.459977 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.459942 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.561435 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.561634 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561455 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.561634 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.561634 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561536 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0255c61-df1b-412e-917d-6fd85ffcedb2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.561634 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.561634 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5l2k\" (UniqueName: \"kubernetes.io/projected/b0255c61-df1b-412e-917d-6fd85ffcedb2-kube-api-access-j5l2k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.561960 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561936 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.562086 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561962 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.562086 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.561998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.563915 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.563896 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b0255c61-df1b-412e-917d-6fd85ffcedb2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.564196 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.564179 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0255c61-df1b-412e-917d-6fd85ffcedb2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.570397 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.570364 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5l2k\" (UniqueName: \"kubernetes.io/projected/b0255c61-df1b-412e-917d-6fd85ffcedb2-kube-api-access-j5l2k\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn\" (UID: \"b0255c61-df1b-412e-917d-6fd85ffcedb2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.684560 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.684471 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:01.818440 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:01.818412 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn"] Jul 18 01:05:01.820178 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:05:01.820152 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0255c61_df1b_412e_917d_6fd85ffcedb2.slice/crio-64953251de4904aeddd712b1af9e1ace00d10e57d3a98e017f1c4f4ce2afe2ce WatchSource:0}: Error finding container 64953251de4904aeddd712b1af9e1ace00d10e57d3a98e017f1c4f4ce2afe2ce: Status 404 returned error can't find the container with id 64953251de4904aeddd712b1af9e1ace00d10e57d3a98e017f1c4f4ce2afe2ce Jul 18 01:05:02.831639 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:02.831605 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" event={"ID":"b0255c61-df1b-412e-917d-6fd85ffcedb2","Type":"ContainerStarted","Data":"5c6336cfa237dacbc3534c4a26c6ebe35be4949ea279ce4af903acdd5a51585c"} Jul 18 01:05:02.832034 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:02.831660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" event={"ID":"b0255c61-df1b-412e-917d-6fd85ffcedb2","Type":"ContainerStarted","Data":"64953251de4904aeddd712b1af9e1ace00d10e57d3a98e017f1c4f4ce2afe2ce"} Jul 18 01:05:02.854677 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:02.854604 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" podStartSLOduration=1.6806308749999999 podStartE2EDuration="1.854586294s" totalImagesPullingTime="173.955419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:05:02.852621184 +0000 UTC m=+602.378384877" watchObservedRunningTime="2026-07-18 01:05:02.854586294 +0000 UTC m=+602.380349968" Jul 18 01:05:11.684703 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:11.684666 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:11.687180 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:11.684732 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:11.697690 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:11.697670 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:05:11.893884 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:05:11.893854 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn" Jul 18 01:21:11.287276 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.287238 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs"] Jul 18 01:21:11.290506 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.290489 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.293566 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.293540 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d0a195eb-openshift-default-dockercfg-bttkk\"" Jul 18 01:21:11.332486 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-certs\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332667 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-credential-socket\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332667 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f336d-5b84-4398-a3d2-b3202088f7de-istiod-ca-cert\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332667 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332640 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-envoy\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332817 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332688 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f336d-5b84-4398-a3d2-b3202088f7de-istio-podinfo\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332817 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332714 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-data\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332817 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-istio-token\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332817 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332780 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-socket\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.332817 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.332798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4z6q\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-kube-api-access-s4z6q\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.370720 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.370687 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs"] Jul 18 01:21:11.433903 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.433872 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-envoy\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434105 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.433921 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f336d-5b84-4398-a3d2-b3202088f7de-istio-podinfo\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434105 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.433951 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-data\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434105 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.433974 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-istio-token\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434105 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.433999 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-socket\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434286 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4z6q\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-kube-api-access-s4z6q\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434387 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434335 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-certs\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434467 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434447 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-data\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434525 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434473 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-credential-socket\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434580 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-socket\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434580 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434566 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f336d-5b84-4398-a3d2-b3202088f7de-istiod-ca-cert\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434722 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434699 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-certs\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.434789 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.434721 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-credential-socket\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.435225 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.435204 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f336d-5b84-4398-a3d2-b3202088f7de-istiod-ca-cert\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.436960 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.436935 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f336d-5b84-4398-a3d2-b3202088f7de-istio-podinfo\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.437089 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.437077 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-envoy\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.450575 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.450547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-istio-token\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.453052 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.453008 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4z6q\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-kube-api-access-s4z6q\") pod \"e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.600261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.600235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:11.740175 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.740147 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs"] Jul 18 01:21:11.741962 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:21:11.741935 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292f336d_5b84_4398_a3d2_b3202088f7de.slice/crio-09f435c00265f1a89f552a0704c032fc51ef5cf0585658c16efa4f4f81672f90 WatchSource:0}: Error finding container 09f435c00265f1a89f552a0704c032fc51ef5cf0585658c16efa4f4f81672f90: Status 404 returned error can't find the container with id 09f435c00265f1a89f552a0704c032fc51ef5cf0585658c16efa4f4f81672f90 Jul 18 01:21:11.743983 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.743952 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:11.744141 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.744044 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:11.744141 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:11.744094 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:12.637428 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:12.637394 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" event={"ID":"292f336d-5b84-4398-a3d2-b3202088f7de","Type":"ContainerStarted","Data":"2aad89365d1edad1b7793b615937e01c6f7a10f8aa71a3f3e10ffad21e32f6c1"} Jul 18 01:21:12.637797 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:12.637458 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" event={"ID":"292f336d-5b84-4398-a3d2-b3202088f7de","Type":"ContainerStarted","Data":"09f435c00265f1a89f552a0704c032fc51ef5cf0585658c16efa4f4f81672f90"} Jul 18 01:21:12.660132 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:12.660075 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" podStartSLOduration=1.660058373 podStartE2EDuration="1.660058373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:21:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:21:12.658102051 +0000 UTC m=+1572.183865749" watchObservedRunningTime="2026-07-18 01:21:12.660058373 +0000 UTC m=+1572.185822049" Jul 18 01:21:13.601324 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:13.601291 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:13.606187 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:13.606162 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:13.642940 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:13.642904 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:13.643816 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:13.643794 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:26.721584 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:26.721544 2556 generic.go:356] "Generic (PLEG): container finished" podID="292f336d-5b84-4398-a3d2-b3202088f7de" containerID="2aad89365d1edad1b7793b615937e01c6f7a10f8aa71a3f3e10ffad21e32f6c1" exitCode=0 Jul 18 01:21:26.722097 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:26.721616 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" event={"ID":"292f336d-5b84-4398-a3d2-b3202088f7de","Type":"ContainerDied","Data":"2aad89365d1edad1b7793b615937e01c6f7a10f8aa71a3f3e10ffad21e32f6c1"} Jul 18 01:21:26.722097 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:26.722006 2556 scope.go:117] "RemoveContainer" containerID="2aad89365d1edad1b7793b615937e01c6f7a10f8aa71a3f3e10ffad21e32f6c1" Jul 18 01:21:26.722994 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:26.722969 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:26.723069 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:26.723058 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:26.723142 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:26.723090 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:27.728515 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:27.728483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" event={"ID":"292f336d-5b84-4398-a3d2-b3202088f7de","Type":"ContainerStarted","Data":"0218ec6c0a1914abb78e20cda0b26930422862ab8b2035972631e061cb07cb08"} Jul 18 01:21:28.601176 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:28.601134 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:28.602409 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:28.602381 2556 patch_prober.go:28] interesting pod/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 18 01:21:28.602515 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:28.602443 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 18 01:21:28.643664 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:28.643629 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:29.600934 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:29.600882 2556 patch_prober.go:28] interesting pod/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 18 01:21:29.601506 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:29.600939 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 18 01:21:30.601680 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:30.601634 2556 patch_prober.go:28] interesting pod/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 18 01:21:30.602143 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:30.601713 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 18 01:21:31.604928 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:31.604901 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:31.605777 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:31.605761 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:21:54.732648 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:54.732567 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs"] Jul 18 01:21:54.733170 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:54.732797 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" containerID="cri-o://0218ec6c0a1914abb78e20cda0b26930422862ab8b2035972631e061cb07cb08" gracePeriod=30 Jul 18 01:21:55.700072 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.700038 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g"] Jul 18 01:21:55.703602 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.703586 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.705962 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.705940 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-2d70ef2b-gw-openshift-default-dockercfg-x5wsf\"" Jul 18 01:21:55.717444 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.717420 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g"] Jul 18 01:21:55.754551 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-credential-socket\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.754551 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754551 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00f287-9884-4a30-ac53-b2a4fc203d66-istiod-ca-cert\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.755083 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrvj\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-kube-api-access-pmrvj\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.755083 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-token\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.755083 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-certs\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.755083 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754819 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-envoy\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.755083 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754863 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-socket\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.755083 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754885 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-data\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.755083 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.754913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-podinfo\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.855578 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-token\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.855747 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-certs\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.855747 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-envoy\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.855747 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-socket\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.855747 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855645 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-data\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.855747 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-podinfo\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.856107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-credential-socket\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.856107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855886 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00f287-9884-4a30-ac53-b2a4fc203d66-istiod-ca-cert\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.856107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.855941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrvj\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-kube-api-access-pmrvj\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.856241 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.856106 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-socket\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.856241 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.856155 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-data\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.856678 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.856181 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-certs\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.856759 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.856738 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-credential-socket\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.860036 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.857239 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00f287-9884-4a30-ac53-b2a4fc203d66-istiod-ca-cert\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.860630 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.860605 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-podinfo\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.865994 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.865072 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-envoy\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.865994 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.865089 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-token\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:55.868961 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:55.868921 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrvj\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-kube-api-access-pmrvj\") pod \"e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:56.013870 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.013773 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:56.159034 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.158991 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g"] Jul 18 01:21:56.161322 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:21:56.161294 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d00f287_9884_4a30_ac53_b2a4fc203d66.slice/crio-dcd2d7948e803ded1c7c862bbe800e9fd96d00098fc467684513c41fc0eed3b0 WatchSource:0}: Error finding container dcd2d7948e803ded1c7c862bbe800e9fd96d00098fc467684513c41fc0eed3b0: Status 404 returned error can't find the container with id dcd2d7948e803ded1c7c862bbe800e9fd96d00098fc467684513c41fc0eed3b0 Jul 18 01:21:56.163385 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.163353 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:56.163457 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.163422 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:56.163457 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.163450 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:21:56.879620 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.879581 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" event={"ID":"2d00f287-9884-4a30-ac53-b2a4fc203d66","Type":"ContainerStarted","Data":"28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9"} Jul 18 01:21:56.880048 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.879636 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" event={"ID":"2d00f287-9884-4a30-ac53-b2a4fc203d66","Type":"ContainerStarted","Data":"dcd2d7948e803ded1c7c862bbe800e9fd96d00098fc467684513c41fc0eed3b0"} Jul 18 01:21:56.904786 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:56.904730 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" podStartSLOduration=1.904707285 podStartE2EDuration="1.904707285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:21:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:21:56.904120432 +0000 UTC m=+1616.429884107" watchObservedRunningTime="2026-07-18 01:21:56.904707285 +0000 UTC m=+1616.430470961" Jul 18 01:21:57.014678 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:57.014647 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:57.025131 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:57.025100 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:57.885255 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:57.885225 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:57.886400 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:57.886377 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:21:59.897338 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:59.897307 2556 generic.go:356] "Generic (PLEG): container finished" podID="292f336d-5b84-4398-a3d2-b3202088f7de" containerID="0218ec6c0a1914abb78e20cda0b26930422862ab8b2035972631e061cb07cb08" exitCode=0 Jul 18 01:21:59.897739 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:59.897376 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" event={"ID":"292f336d-5b84-4398-a3d2-b3202088f7de","Type":"ContainerDied","Data":"0218ec6c0a1914abb78e20cda0b26930422862ab8b2035972631e061cb07cb08"} Jul 18 01:21:59.897739 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:59.897436 2556 scope.go:117] "RemoveContainer" containerID="2aad89365d1edad1b7793b615937e01c6f7a10f8aa71a3f3e10ffad21e32f6c1" Jul 18 01:21:59.981221 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:21:59.981192 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:22:00.094735 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094635 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-certs\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.094735 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094683 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-socket\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.094735 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094725 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f336d-5b84-4398-a3d2-b3202088f7de-istiod-ca-cert\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.095050 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094750 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4z6q\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-kube-api-access-s4z6q\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.095050 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094777 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-istio-token\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.095050 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094831 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-data\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.095050 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094882 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f336d-5b84-4398-a3d2-b3202088f7de-istio-podinfo\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.095050 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094954 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-credential-socket\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.095050 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094977 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-envoy\") pod \"292f336d-5b84-4398-a3d2-b3202088f7de\" (UID: \"292f336d-5b84-4398-a3d2-b3202088f7de\") " Jul 18 01:22:00.095050 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.094981 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:00.095396 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.095083 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:00.095396 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.095231 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:00.095396 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.095275 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292f336d-5b84-4398-a3d2-b3202088f7de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:22:00.095396 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.095389 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-credential-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.095609 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.095406 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-certs\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.095609 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.095419 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-workload-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.095609 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.095429 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/292f336d-5b84-4398-a3d2-b3202088f7de-istiod-ca-cert\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.096145 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.096116 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-data" (OuterVolumeSpecName: "istio-data") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:00.097195 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.097174 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-istio-token" (OuterVolumeSpecName: "istio-token") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:22:00.097307 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.097290 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-kube-api-access-s4z6q" (OuterVolumeSpecName: "kube-api-access-s4z6q") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "kube-api-access-s4z6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:22:00.097764 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.097741 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/292f336d-5b84-4398-a3d2-b3202088f7de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:22:00.097764 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.097750 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "292f336d-5b84-4398-a3d2-b3202088f7de" (UID: "292f336d-5b84-4398-a3d2-b3202088f7de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:00.196413 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.196371 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-envoy\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.196413 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.196407 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4z6q\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-kube-api-access-s4z6q\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.196413 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.196421 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292f336d-5b84-4398-a3d2-b3202088f7de-istio-token\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.196647 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.196433 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/292f336d-5b84-4398-a3d2-b3202088f7de-istio-data\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.196647 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.196444 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/292f336d-5b84-4398-a3d2-b3202088f7de-istio-podinfo\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:00.904070 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.904035 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" event={"ID":"292f336d-5b84-4398-a3d2-b3202088f7de","Type":"ContainerDied","Data":"09f435c00265f1a89f552a0704c032fc51ef5cf0585658c16efa4f4f81672f90"} Jul 18 01:22:00.904070 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.904073 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs" Jul 18 01:22:00.904486 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.904109 2556 scope.go:117] "RemoveContainer" containerID="0218ec6c0a1914abb78e20cda0b26930422862ab8b2035972631e061cb07cb08" Jul 18 01:22:00.928819 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.928789 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs"] Jul 18 01:22:00.932807 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:00.932779 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d0a195eb-openshift-default-55b776968f-qwfgs"] Jul 18 01:22:01.020498 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:01.020458 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" path="/var/lib/kubelet/pods/292f336d-5b84-4398-a3d2-b3202088f7de/volumes" Jul 18 01:22:11.962702 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:11.962626 2556 generic.go:356] "Generic (PLEG): container finished" podID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerID="28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9" exitCode=0 Jul 18 01:22:11.962702 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:11.962682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" event={"ID":"2d00f287-9884-4a30-ac53-b2a4fc203d66","Type":"ContainerDied","Data":"28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9"} Jul 18 01:22:11.963149 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:11.963077 2556 scope.go:117] "RemoveContainer" containerID="28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9" Jul 18 01:22:11.964142 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:11.964112 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:11.964260 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:11.964193 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:11.964260 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:11.964239 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:12.885409 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:12.885366 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:22:12.969871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:12.969836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" event={"ID":"2d00f287-9884-4a30-ac53-b2a4fc203d66","Type":"ContainerStarted","Data":"cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6"} Jul 18 01:22:13.019064 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:13.015103 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:22:13.019251 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:13.019169 2556 patch_prober.go:28] interesting pod/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 01:22:13.019429 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:13.019398 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 01:22:14.014851 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:14.014823 2556 patch_prober.go:28] interesting pod/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 01:22:14.015261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:14.014870 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 01:22:15.014517 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:15.014481 2556 patch_prober.go:28] interesting pod/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 01:22:15.014697 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:15.014543 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 01:22:16.014923 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:16.014888 2556 patch_prober.go:28] interesting pod/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body= Jul 18 01:22:16.015337 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:16.014945 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" Jul 18 01:22:17.018698 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:17.018671 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:22:17.019102 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:17.018936 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:22:17.019623 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:17.019606 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:22:38.617810 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:38.617773 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g"] Jul 18 01:22:38.618397 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:38.618007 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" containerID="cri-o://cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6" gracePeriod=30 Jul 18 01:22:39.368317 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.368285 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8"] Jul 18 01:22:39.368651 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.368639 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" Jul 18 01:22:39.368719 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.368652 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" Jul 18 01:22:39.368719 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.368668 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" Jul 18 01:22:39.368719 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.368674 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" Jul 18 01:22:39.368871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.368739 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" Jul 18 01:22:39.368871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.368746 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="292f336d-5b84-4398-a3d2-b3202088f7de" containerName="istio-proxy" Jul 18 01:22:39.371736 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.371710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.374887 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.374863 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e06bd601-openshift-default-dockercfg-24rkn\"" Jul 18 01:22:39.385366 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.385335 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8"] Jul 18 01:22:39.452395 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452361 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-socket\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452604 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452433 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-credential-socket\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452604 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-data\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452604 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452544 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-podinfo\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452604 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-envoy\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452924 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452610 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-token\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452924 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452641 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istiod-ca-cert\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452924 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz5np\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-kube-api-access-vz5np\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.452924 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.452707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-certs\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554101 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554059 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-credential-socket\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554101 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-data\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554365 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-podinfo\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554365 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-envoy\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554365 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-token\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554365 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554360 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istiod-ca-cert\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554580 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554376 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz5np\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-kube-api-access-vz5np\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554580 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-certs\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554580 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-socket\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554580 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-credential-socket\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554786 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554582 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-data\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554957 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-certs\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.554957 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.554953 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-socket\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.555201 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.555182 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istiod-ca-cert\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.556724 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.556698 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-envoy\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.556922 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.556904 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-podinfo\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.573967 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.573926 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz5np\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-kube-api-access-vz5np\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.574741 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.574721 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-token\") pod \"e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.682499 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.682415 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:39.827359 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.827331 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8"] Jul 18 01:22:39.828533 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:22:39.828511 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f901e70_8eeb_4ab1_8b08_db9d95e24106.slice/crio-0ac4e716b05927e6aacce1d8562aebbac97f8f8b20da4d1147809bbead757eec WatchSource:0}: Error finding container 0ac4e716b05927e6aacce1d8562aebbac97f8f8b20da4d1147809bbead757eec: Status 404 returned error can't find the container with id 0ac4e716b05927e6aacce1d8562aebbac97f8f8b20da4d1147809bbead757eec Jul 18 01:22:39.830694 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.830654 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:39.830756 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.830731 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:39.830796 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:39.830758 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:40.113721 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:40.113690 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" event={"ID":"5f901e70-8eeb-4ab1-8b08-db9d95e24106","Type":"ContainerStarted","Data":"3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca"} Jul 18 01:22:40.113921 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:40.113742 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" event={"ID":"5f901e70-8eeb-4ab1-8b08-db9d95e24106","Type":"ContainerStarted","Data":"0ac4e716b05927e6aacce1d8562aebbac97f8f8b20da4d1147809bbead757eec"} Jul 18 01:22:40.136790 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:40.136734 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" podStartSLOduration=1.136717739 podStartE2EDuration="1.136717739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:22:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:22:40.135263591 +0000 UTC m=+1659.661027277" watchObservedRunningTime="2026-07-18 01:22:40.136717739 +0000 UTC m=+1659.662481414" Jul 18 01:22:40.683290 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:40.683249 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:40.688526 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:40.688498 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:41.118817 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:41.118787 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:41.119714 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:41.119695 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:43.868753 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.868726 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:22:43.995172 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995078 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-podinfo\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995172 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995118 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-credential-socket\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995172 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995138 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-token\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995172 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995158 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00f287-9884-4a30-ac53-b2a4fc203d66-istiod-ca-cert\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995505 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995198 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmrvj\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-kube-api-access-pmrvj\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995505 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995230 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-envoy\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995505 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995254 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-socket\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995505 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995285 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-data\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995505 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995392 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-certs\") pod \"2d00f287-9884-4a30-ac53-b2a4fc203d66\" (UID: \"2d00f287-9884-4a30-ac53-b2a4fc203d66\") " Jul 18 01:22:43.995505 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995417 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:43.995808 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995612 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:43.995808 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995636 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d00f287-9884-4a30-ac53-b2a4fc203d66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:22:43.995808 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995763 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d00f287-9884-4a30-ac53-b2a4fc203d66-istiod-ca-cert\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:43.995808 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995783 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:43.995808 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995796 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-credential-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:43.995808 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.995799 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:43.996498 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.996471 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:43.997643 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.997616 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:22:43.997744 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.997640 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-kube-api-access-pmrvj" (OuterVolumeSpecName: "kube-api-access-pmrvj") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "kube-api-access-pmrvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:22:43.997744 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.997658 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:22:43.997854 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:43.997776 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d00f287-9884-4a30-ac53-b2a4fc203d66" (UID: "2d00f287-9884-4a30-ac53-b2a4fc203d66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:22:44.096296 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.096255 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-workload-certs\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:44.096296 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.096290 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-podinfo\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:44.096296 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.096299 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-token\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:44.096523 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.096309 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmrvj\" (UniqueName: \"kubernetes.io/projected/2d00f287-9884-4a30-ac53-b2a4fc203d66-kube-api-access-pmrvj\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:44.096523 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.096320 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-envoy\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:44.096523 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.096328 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d00f287-9884-4a30-ac53-b2a4fc203d66-istio-data\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:22:44.136821 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.136790 2556 generic.go:356] "Generic (PLEG): container finished" podID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerID="cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6" exitCode=0 Jul 18 01:22:44.137010 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.136840 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" Jul 18 01:22:44.137010 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.136882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" event={"ID":"2d00f287-9884-4a30-ac53-b2a4fc203d66","Type":"ContainerDied","Data":"cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6"} Jul 18 01:22:44.137010 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.136942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g" event={"ID":"2d00f287-9884-4a30-ac53-b2a4fc203d66","Type":"ContainerDied","Data":"dcd2d7948e803ded1c7c862bbe800e9fd96d00098fc467684513c41fc0eed3b0"} Jul 18 01:22:44.137010 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.136971 2556 scope.go:117] "RemoveContainer" containerID="cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6" Jul 18 01:22:44.146598 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.146572 2556 scope.go:117] "RemoveContainer" containerID="28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9" Jul 18 01:22:44.155518 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.155503 2556 scope.go:117] "RemoveContainer" containerID="cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6" Jul 18 01:22:44.155819 ip-10-0-133-101 kubenswrapper[2556]: E0718 01:22:44.155799 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6\": container with ID starting with cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6 not found: ID does not exist" containerID="cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6" Jul 18 01:22:44.155861 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.155832 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6"} err="failed to get container status \"cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6\": rpc error: code = NotFound desc = could not find container \"cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6\": container with ID starting with cfc9f966af4616527b4ebde3d6a170be99f86bb4d3d57a6bce87da21a43d2df6 not found: ID does not exist" Jul 18 01:22:44.155904 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.155866 2556 scope.go:117] "RemoveContainer" containerID="28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9" Jul 18 01:22:44.156136 ip-10-0-133-101 kubenswrapper[2556]: E0718 01:22:44.156116 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9\": container with ID starting with 28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9 not found: ID does not exist" containerID="28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9" Jul 18 01:22:44.156174 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.156142 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9"} err="failed to get container status \"28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9\": rpc error: code = NotFound desc = could not find container \"28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9\": container with ID starting with 28bb6ca8fd938cb35cf5e73861d5ebeef6f2ffae54545be3cba6ee96b77e23a9 not found: ID does not exist" Jul 18 01:22:44.159995 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.159973 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g"] Jul 18 01:22:44.166938 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:44.166911 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-2d70ef2b-gw-openshift-default-8f5794887-sdk6g"] Jul 18 01:22:45.014228 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:45.014199 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" path="/var/lib/kubelet/pods/2d00f287-9884-4a30-ac53-b2a4fc203d66/volumes" Jul 18 01:22:56.120165 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.120121 2556 patch_prober.go:28] interesting pod/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 01:22:56.120656 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.120186 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 01:22:56.205394 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.205363 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerID="3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca" exitCode=0 Jul 18 01:22:56.205564 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.205411 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" event={"ID":"5f901e70-8eeb-4ab1-8b08-db9d95e24106","Type":"ContainerDied","Data":"3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca"} Jul 18 01:22:56.205796 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.205782 2556 scope.go:117] "RemoveContainer" containerID="3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca" Jul 18 01:22:56.206840 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.206812 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:56.206897 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.206877 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:56.206935 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:56.206909 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:22:57.212590 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:57.212557 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" event={"ID":"5f901e70-8eeb-4ab1-8b08-db9d95e24106","Type":"ContainerStarted","Data":"eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0"} Jul 18 01:22:57.683816 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:57.683778 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:22:57.684325 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:57.684239 2556 patch_prober.go:28] interesting pod/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 01:22:57.684510 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:57.684487 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 01:22:58.682884 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:58.682842 2556 patch_prober.go:28] interesting pod/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 01:22:58.683958 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:58.683520 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 01:22:59.683756 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:59.683716 2556 patch_prober.go:28] interesting pod/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 01:22:59.684389 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:22:59.684358 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 01:23:00.683253 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:00.683209 2556 patch_prober.go:28] interesting pod/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body= Jul 18 01:23:00.683573 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:00.683531 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" Jul 18 01:23:01.687174 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:01.687139 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:23:01.687627 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:01.687389 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:23:01.688231 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:01.688214 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:23:23.621138 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:23.621105 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8"] Jul 18 01:23:23.621561 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:23.621323 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" containerID="cri-o://eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0" gracePeriod=30 Jul 18 01:23:24.383087 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.378342 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q"] Jul 18 01:23:24.383087 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.379173 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" Jul 18 01:23:24.383087 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.379193 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" Jul 18 01:23:24.383087 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.379375 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" Jul 18 01:23:24.384664 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.384635 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.387201 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.387180 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-81658c06-openshift-default-dockercfg-klcxn\"" Jul 18 01:23:24.398560 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.398536 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q"] Jul 18 01:23:24.461626 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-token\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.461626 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-socket\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.461887 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8vnn\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-kube-api-access-v8vnn\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.461887 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-envoy\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.461887 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-podinfo\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.461887 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-credential-socket\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.461887 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461881 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-data\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.462158 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461916 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istiod-ca-cert\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.462158 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.461953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-certs\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.562888 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.562851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-envoy\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.562903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-podinfo\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-credential-socket\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563074 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-data\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istiod-ca-cert\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563364 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563143 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-certs\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563364 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-token\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563364 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563309 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-socket\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563364 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8vnn\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-kube-api-access-v8vnn\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563595 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563459 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-data\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563595 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563542 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-certs\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563707 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563639 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-credential-socket\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.563763 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.563728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-socket\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.564089 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.564064 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istiod-ca-cert\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.565432 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.565409 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-envoy\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.565528 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.565484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-podinfo\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.572367 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.572340 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8vnn\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-kube-api-access-v8vnn\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.572907 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.572889 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-token\") pod \"e2e-derive-81658c06-openshift-default-74886cd575-5569q\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.694853 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.694756 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:24.840277 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.840218 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q"] Jul 18 01:23:24.841790 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:23:24.841757 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f92ffb_08eb_4096_8d2f_5ab9ab35260a.slice/crio-eb00aaef81ca1cba93fdd47d5b8ba14119c19523823bf7fcaea0abc429a3e593 WatchSource:0}: Error finding container eb00aaef81ca1cba93fdd47d5b8ba14119c19523823bf7fcaea0abc429a3e593: Status 404 returned error can't find the container with id eb00aaef81ca1cba93fdd47d5b8ba14119c19523823bf7fcaea0abc429a3e593 Jul 18 01:23:24.844173 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.844143 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:23:24.844241 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.844207 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:23:24.844241 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:24.844234 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:23:25.356341 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:25.356302 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" event={"ID":"70f92ffb-08eb-4096-8d2f-5ab9ab35260a","Type":"ContainerStarted","Data":"4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09"} Jul 18 01:23:25.356580 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:25.356360 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" event={"ID":"70f92ffb-08eb-4096-8d2f-5ab9ab35260a","Type":"ContainerStarted","Data":"eb00aaef81ca1cba93fdd47d5b8ba14119c19523823bf7fcaea0abc429a3e593"} Jul 18 01:23:25.381592 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:25.381538 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" podStartSLOduration=1.381519473 podStartE2EDuration="1.381519473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:23:25.37983885 +0000 UTC m=+1704.905602524" watchObservedRunningTime="2026-07-18 01:23:25.381519473 +0000 UTC m=+1704.907283148" Jul 18 01:23:25.695589 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:25.695486 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:25.700299 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:25.700274 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:26.361786 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:26.361753 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:26.362675 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:26.362655 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:28.871185 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.871161 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:23:28.903274 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903199 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-podinfo\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903274 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903244 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-socket\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903496 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903311 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-envoy\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903496 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903356 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istiod-ca-cert\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903496 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903394 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-certs\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903496 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903434 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-data\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903496 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903461 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz5np\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-kube-api-access-vz5np\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903738 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903506 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-credential-socket\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903738 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903533 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-token\") pod \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\" (UID: \"5f901e70-8eeb-4ab1-8b08-db9d95e24106\") " Jul 18 01:23:28.903738 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903604 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:23:28.904081 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903808 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:23:28.904081 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903867 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:28.904081 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903941 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:23:28.904081 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.903978 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:23:28.904648 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.904558 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:23:28.905946 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.905911 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:23:28.906080 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.906046 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-kube-api-access-vz5np" (OuterVolumeSpecName: "kube-api-access-vz5np") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "kube-api-access-vz5np". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:23:28.906154 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.906078 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:23:28.906224 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:28.906197 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f901e70-8eeb-4ab1-8b08-db9d95e24106" (UID: "5f901e70-8eeb-4ab1-8b08-db9d95e24106"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:23:29.004892 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004860 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-credential-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.004892 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004890 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-token\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.005173 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004904 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-podinfo\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.005173 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004915 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-envoy\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.005173 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004926 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istiod-ca-cert\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.005173 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004937 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-workload-certs\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.005173 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004946 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f901e70-8eeb-4ab1-8b08-db9d95e24106-istio-data\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.005173 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.004957 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz5np\" (UniqueName: \"kubernetes.io/projected/5f901e70-8eeb-4ab1-8b08-db9d95e24106-kube-api-access-vz5np\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:23:29.379139 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.379108 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerID="eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0" exitCode=0 Jul 18 01:23:29.379321 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.379186 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" Jul 18 01:23:29.379321 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.379196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" event={"ID":"5f901e70-8eeb-4ab1-8b08-db9d95e24106","Type":"ContainerDied","Data":"eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0"} Jul 18 01:23:29.379321 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.379263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8" event={"ID":"5f901e70-8eeb-4ab1-8b08-db9d95e24106","Type":"ContainerDied","Data":"0ac4e716b05927e6aacce1d8562aebbac97f8f8b20da4d1147809bbead757eec"} Jul 18 01:23:29.379321 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.379294 2556 scope.go:117] "RemoveContainer" containerID="eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0" Jul 18 01:23:29.388905 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.388889 2556 scope.go:117] "RemoveContainer" containerID="3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca" Jul 18 01:23:29.397279 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.397253 2556 scope.go:117] "RemoveContainer" containerID="eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0" Jul 18 01:23:29.397552 ip-10-0-133-101 kubenswrapper[2556]: E0718 01:23:29.397533 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0\": container with ID starting with eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0 not found: ID does not exist" containerID="eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0" Jul 18 01:23:29.397633 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.397563 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0"} err="failed to get container status \"eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0\": rpc error: code = NotFound desc = could not find container \"eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0\": container with ID starting with eb225fd31c88707f16bcce531c8e0640fdf622d50603cc0fae5babd8d527fda0 not found: ID does not exist" Jul 18 01:23:29.397633 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.397586 2556 scope.go:117] "RemoveContainer" containerID="3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca" Jul 18 01:23:29.397857 ip-10-0-133-101 kubenswrapper[2556]: E0718 01:23:29.397837 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca\": container with ID starting with 3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca not found: ID does not exist" containerID="3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca" Jul 18 01:23:29.397915 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.397863 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca"} err="failed to get container status \"3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca\": rpc error: code = NotFound desc = could not find container \"3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca\": container with ID starting with 3d4b1e9d25ad2d5a364d36372c255ba29d5dda94a611f6bf842ef4c60e9f8fca not found: ID does not exist" Jul 18 01:23:29.399034 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.398997 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8"] Jul 18 01:23:29.404437 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:29.404418 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e06bd601-openshift-default-6c69fb68f5-dhnm8"] Jul 18 01:23:31.014485 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:31.014452 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" path="/var/lib/kubelet/pods/5f901e70-8eeb-4ab1-8b08-db9d95e24106/volumes" Jul 18 01:23:38.431479 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:38.431444 2556 generic.go:356] "Generic (PLEG): container finished" podID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerID="4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09" exitCode=0 Jul 18 01:23:38.431889 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:38.431518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" event={"ID":"70f92ffb-08eb-4096-8d2f-5ab9ab35260a","Type":"ContainerDied","Data":"4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09"} Jul 18 01:23:38.431929 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:38.431910 2556 scope.go:117] "RemoveContainer" containerID="4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09" Jul 18 01:23:38.433079 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:38.433049 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:23:38.433189 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:38.433120 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:23:38.433189 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:38.433172 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:23:39.438330 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:39.438298 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" event={"ID":"70f92ffb-08eb-4096-8d2f-5ab9ab35260a","Type":"ContainerStarted","Data":"49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2"} Jul 18 01:23:39.696199 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:39.696102 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:39.696410 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:39.696384 2556 patch_prober.go:28] interesting pod/e2e-derive-81658c06-openshift-default-74886cd575-5569q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 01:23:39.696485 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:39.696462 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 01:23:40.696318 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:40.696280 2556 patch_prober.go:28] interesting pod/e2e-derive-81658c06-openshift-default-74886cd575-5569q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 01:23:40.696742 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:40.696342 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 01:23:41.362531 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:41.362496 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:41.696197 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:41.696084 2556 patch_prober.go:28] interesting pod/e2e-derive-81658c06-openshift-default-74886cd575-5569q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 01:23:41.696197 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:41.696153 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 01:23:42.695819 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:42.695779 2556 patch_prober.go:28] interesting pod/e2e-derive-81658c06-openshift-default-74886cd575-5569q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 18 01:23:42.696150 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:42.696107 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 18 01:23:43.699315 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:43.699286 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:23:43.700365 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:23:43.700345 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:24:06.844033 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:06.843986 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q"] Jul 18 01:24:06.844457 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:06.844244 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" containerID="cri-o://49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2" gracePeriod=30 Jul 18 01:24:12.096517 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.096487 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:24:12.192612 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192523 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istiod-ca-cert\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192612 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192563 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-token\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192612 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192590 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8vnn\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-kube-api-access-v8vnn\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192620 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-certs\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192656 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-podinfo\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192673 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-credential-socket\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192713 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-socket\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192738 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-data\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.192871 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192810 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-envoy\") pod \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\" (UID: \"70f92ffb-08eb-4096-8d2f-5ab9ab35260a\") " Jul 18 01:24:12.193219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192961 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:24:12.193219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.192978 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:24:12.193219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.193002 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:24:12.193219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.193125 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-certs\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.193219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.193143 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-credential-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.193219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.193156 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istiod-ca-cert\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.193219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.193200 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:24:12.193738 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.193633 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-data" (OuterVolumeSpecName: "istio-data") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:24:12.194895 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.194872 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-token" (OuterVolumeSpecName: "istio-token") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:24:12.195065 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.195044 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:24:12.195460 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.195444 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:24:12.195510 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.195483 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-kube-api-access-v8vnn" (OuterVolumeSpecName: "kube-api-access-v8vnn") pod "70f92ffb-08eb-4096-8d2f-5ab9ab35260a" (UID: "70f92ffb-08eb-4096-8d2f-5ab9ab35260a"). InnerVolumeSpecName "kube-api-access-v8vnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:24:12.294344 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.294310 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-envoy\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.294344 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.294338 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-token\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.294344 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.294350 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8vnn\" (UniqueName: \"kubernetes.io/projected/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-kube-api-access-v8vnn\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.294567 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.294359 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-podinfo\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.294567 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.294368 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-workload-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.294567 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.294375 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/70f92ffb-08eb-4096-8d2f-5ab9ab35260a-istio-data\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:24:12.610520 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.610485 2556 generic.go:356] "Generic (PLEG): container finished" podID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerID="49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2" exitCode=0 Jul 18 01:24:12.610690 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.610533 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" Jul 18 01:24:12.610690 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.610576 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" event={"ID":"70f92ffb-08eb-4096-8d2f-5ab9ab35260a","Type":"ContainerDied","Data":"49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2"} Jul 18 01:24:12.610690 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.610663 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q" event={"ID":"70f92ffb-08eb-4096-8d2f-5ab9ab35260a","Type":"ContainerDied","Data":"eb00aaef81ca1cba93fdd47d5b8ba14119c19523823bf7fcaea0abc429a3e593"} Jul 18 01:24:12.610690 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.610686 2556 scope.go:117] "RemoveContainer" containerID="49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2" Jul 18 01:24:12.620137 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.620117 2556 scope.go:117] "RemoveContainer" containerID="4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09" Jul 18 01:24:12.628482 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.628461 2556 scope.go:117] "RemoveContainer" containerID="49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2" Jul 18 01:24:12.628772 ip-10-0-133-101 kubenswrapper[2556]: E0718 01:24:12.628752 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2\": container with ID starting with 49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2 not found: ID does not exist" containerID="49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2" Jul 18 01:24:12.628847 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.628786 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2"} err="failed to get container status \"49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2\": rpc error: code = NotFound desc = could not find container \"49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2\": container with ID starting with 49299d70a54d36d2043504bad38447de93525740be894c7f5b565c32457adab2 not found: ID does not exist" Jul 18 01:24:12.628847 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.628815 2556 scope.go:117] "RemoveContainer" containerID="4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09" Jul 18 01:24:12.629121 ip-10-0-133-101 kubenswrapper[2556]: E0718 01:24:12.629103 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09\": container with ID starting with 4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09 not found: ID does not exist" containerID="4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09" Jul 18 01:24:12.629167 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.629128 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09"} err="failed to get container status \"4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09\": rpc error: code = NotFound desc = could not find container \"4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09\": container with ID starting with 4955f38f6ec94a1897c1f31b4b63303c8fc667d78f2da0720e7b07f348502c09 not found: ID does not exist" Jul 18 01:24:12.633469 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.633437 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q"] Jul 18 01:24:12.637989 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:12.637967 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-81658c06-openshift-default-74886cd575-5569q"] Jul 18 01:24:13.016518 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:24:13.016437 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" path="/var/lib/kubelet/pods/70f92ffb-08eb-4096-8d2f-5ab9ab35260a/volumes" Jul 18 01:25:49.081193 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081161 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr"] Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081657 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081677 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081694 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081702 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081724 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081734 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081744 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081752 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081761 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" Jul 18 01:25:49.081775 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081768 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" Jul 18 01:25:49.082271 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081847 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" Jul 18 01:25:49.082271 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081861 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" Jul 18 01:25:49.082271 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.081870 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d00f287-9884-4a30-ac53-b2a4fc203d66" containerName="istio-proxy" Jul 18 01:25:49.085109 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.085084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.087568 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.087546 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-db0b0851-openshift-default-dockercfg-vltqb\"" Jul 18 01:25:49.106172 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.106115 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr"] Jul 18 01:25:49.166313 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166261 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-socket\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.166549 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f578078-3f61-4a93-9580-10a29577faf9-istiod-ca-cert\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.166607 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-certs\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.166674 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-envoy\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.166716 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166687 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbtgr\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-kube-api-access-mbtgr\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.166882 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-data\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.166970 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166922 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-credential-socket\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.166970 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166956 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f578078-3f61-4a93-9580-10a29577faf9-istio-podinfo\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.167072 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.166977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-istio-token\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268326 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268292 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-data\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268503 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268336 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-credential-socket\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268503 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f578078-3f61-4a93-9580-10a29577faf9-istio-podinfo\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268595 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-istio-token\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268595 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-socket\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268692 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268612 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f578078-3f61-4a93-9580-10a29577faf9-istiod-ca-cert\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268692 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268654 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-certs\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268692 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268682 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-credential-socket\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268833 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-envoy\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268833 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268723 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbtgr\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-kube-api-access-mbtgr\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268833 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-data\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268972 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268932 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-socket\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.268972 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.268939 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-certs\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.269390 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.269371 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f578078-3f61-4a93-9580-10a29577faf9-istiod-ca-cert\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.271144 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.271118 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-envoy\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.271262 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.271171 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f578078-3f61-4a93-9580-10a29577faf9-istio-podinfo\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.276744 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.276713 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-istio-token\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.276941 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.276918 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbtgr\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-kube-api-access-mbtgr\") pod \"e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.395769 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.395741 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:49.534723 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.534698 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr"] Jul 18 01:25:49.536258 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:25:49.536231 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f578078_3f61_4a93_9580_10a29577faf9.slice/crio-5ecfbcea2fdf977cb06c821ca9070f370f4ac42cdc4d2309a3c21c7600761df7 WatchSource:0}: Error finding container 5ecfbcea2fdf977cb06c821ca9070f370f4ac42cdc4d2309a3c21c7600761df7: Status 404 returned error can't find the container with id 5ecfbcea2fdf977cb06c821ca9070f370f4ac42cdc4d2309a3c21c7600761df7 Jul 18 01:25:49.538341 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.538310 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:25:49.538430 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.538384 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:25:49.538430 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:49.538414 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:25:50.091976 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:50.091931 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" event={"ID":"4f578078-3f61-4a93-9580-10a29577faf9","Type":"ContainerStarted","Data":"03b0658f87a7f2af3e0f4f1edb12fcc791ab652e7f633338f5f368aa74f70706"} Jul 18 01:25:50.092382 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:50.092029 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" event={"ID":"4f578078-3f61-4a93-9580-10a29577faf9","Type":"ContainerStarted","Data":"5ecfbcea2fdf977cb06c821ca9070f370f4ac42cdc4d2309a3c21c7600761df7"} Jul 18 01:25:50.113725 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:50.113669 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" podStartSLOduration=1.113654508 podStartE2EDuration="1.113654508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 01:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:25:50.112922638 +0000 UTC m=+1849.638686331" watchObservedRunningTime="2026-07-18 01:25:50.113654508 +0000 UTC m=+1849.639418183" Jul 18 01:25:50.396737 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:50.396697 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:50.401761 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:50.401732 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:51.097614 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:51.097576 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:25:51.098652 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:25:51.098628 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:26:02.156261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:02.156226 2556 generic.go:356] "Generic (PLEG): container finished" podID="4f578078-3f61-4a93-9580-10a29577faf9" containerID="03b0658f87a7f2af3e0f4f1edb12fcc791ab652e7f633338f5f368aa74f70706" exitCode=0 Jul 18 01:26:02.156731 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:02.156301 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" event={"ID":"4f578078-3f61-4a93-9580-10a29577faf9","Type":"ContainerDied","Data":"03b0658f87a7f2af3e0f4f1edb12fcc791ab652e7f633338f5f368aa74f70706"} Jul 18 01:26:02.156731 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:02.156698 2556 scope.go:117] "RemoveContainer" containerID="03b0658f87a7f2af3e0f4f1edb12fcc791ab652e7f633338f5f368aa74f70706" Jul 18 01:26:02.157733 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:02.157706 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:26:02.157789 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:02.157775 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:26:02.157828 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:02.157812 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 18 01:26:03.164537 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:03.164497 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" event={"ID":"4f578078-3f61-4a93-9580-10a29577faf9","Type":"ContainerStarted","Data":"1765c8893cb12a5bedf211e3d74a381baee96126f1835aeebb6ac561e6e0e80f"} Jul 18 01:26:03.396339 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:03.396290 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:26:03.397701 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:03.397672 2556 patch_prober.go:28] interesting pod/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 18 01:26:03.397829 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:03.397727 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 18 01:26:04.396948 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:04.396909 2556 patch_prober.go:28] interesting pod/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 18 01:26:04.397407 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:04.396965 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 18 01:26:05.396793 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:05.396743 2556 patch_prober.go:28] interesting pod/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 18 01:26:05.396981 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:05.396817 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 18 01:26:06.098096 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:06.098050 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:26:06.396549 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:06.396456 2556 patch_prober.go:28] interesting pod/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body= Jul 18 01:26:06.396549 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:06.396515 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" Jul 18 01:26:07.400633 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:07.400595 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:26:07.401734 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:07.401712 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:26:25.173784 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:25.173747 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr"] Jul 18 01:26:25.174333 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:25.173998 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" containerID="cri-o://1765c8893cb12a5bedf211e3d74a381baee96126f1835aeebb6ac561e6e0e80f" gracePeriod=30 Jul 18 01:26:30.305200 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.305166 2556 generic.go:356] "Generic (PLEG): container finished" podID="4f578078-3f61-4a93-9580-10a29577faf9" containerID="1765c8893cb12a5bedf211e3d74a381baee96126f1835aeebb6ac561e6e0e80f" exitCode=0 Jul 18 01:26:30.305631 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.305218 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" event={"ID":"4f578078-3f61-4a93-9580-10a29577faf9","Type":"ContainerDied","Data":"1765c8893cb12a5bedf211e3d74a381baee96126f1835aeebb6ac561e6e0e80f"} Jul 18 01:26:30.305631 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.305291 2556 scope.go:117] "RemoveContainer" containerID="03b0658f87a7f2af3e0f4f1edb12fcc791ab652e7f633338f5f368aa74f70706" Jul 18 01:26:30.428121 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.428099 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:26:30.552147 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552007 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-certs\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552147 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552106 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f578078-3f61-4a93-9580-10a29577faf9-istio-podinfo\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552357 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552171 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-data\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552357 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552205 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-istio-token\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552357 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552242 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f578078-3f61-4a93-9580-10a29577faf9-istiod-ca-cert\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552357 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552272 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbtgr\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-kube-api-access-mbtgr\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552357 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552317 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:26:30.552357 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552330 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-socket\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552665 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552401 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-envoy\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552665 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552483 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-credential-socket\") pod \"4f578078-3f61-4a93-9580-10a29577faf9\" (UID: \"4f578078-3f61-4a93-9580-10a29577faf9\") " Jul 18 01:26:30.552781 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552695 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f578078-3f61-4a93-9580-10a29577faf9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 18 01:26:30.552835 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552796 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-certs\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.552835 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552817 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f578078-3f61-4a93-9580-10a29577faf9-istiod-ca-cert\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.552932 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552879 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:26:30.552989 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.552961 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:26:30.553388 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.553361 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:26:30.554527 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.554504 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f578078-3f61-4a93-9580-10a29577faf9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 18 01:26:30.554650 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.554632 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 18 01:26:30.555027 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.554986 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:26:30.555123 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.555032 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-kube-api-access-mbtgr" (OuterVolumeSpecName: "kube-api-access-mbtgr") pod "4f578078-3f61-4a93-9580-10a29577faf9" (UID: "4f578078-3f61-4a93-9580-10a29577faf9"). InnerVolumeSpecName "kube-api-access-mbtgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 18 01:26:30.653281 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.653241 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f578078-3f61-4a93-9580-10a29577faf9-istio-podinfo\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.653281 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.653272 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-data\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.653281 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.653281 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-istio-token\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.653281 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.653289 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbtgr\" (UniqueName: \"kubernetes.io/projected/4f578078-3f61-4a93-9580-10a29577faf9-kube-api-access-mbtgr\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.653543 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.653298 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-workload-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.653543 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.653307 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-istio-envoy\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:30.653543 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:30.653314 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f578078-3f61-4a93-9580-10a29577faf9-credential-socket\") on node \"ip-10-0-133-101.ec2.internal\" DevicePath \"\"" Jul 18 01:26:31.311382 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:31.311302 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" Jul 18 01:26:31.311382 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:31.311336 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr" event={"ID":"4f578078-3f61-4a93-9580-10a29577faf9","Type":"ContainerDied","Data":"5ecfbcea2fdf977cb06c821ca9070f370f4ac42cdc4d2309a3c21c7600761df7"} Jul 18 01:26:31.311869 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:31.311395 2556 scope.go:117] "RemoveContainer" containerID="1765c8893cb12a5bedf211e3d74a381baee96126f1835aeebb6ac561e6e0e80f" Jul 18 01:26:31.329560 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:31.329533 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr"] Jul 18 01:26:31.333382 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:31.333360 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-db0b0851-openshift-default-777f58f795-4s9wr"] Jul 18 01:26:33.014373 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:33.014341 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f578078-3f61-4a93-9580-10a29577faf9" path="/var/lib/kubelet/pods/4f578078-3f61-4a93-9580-10a29577faf9/volumes" Jul 18 01:26:44.463843 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:44.463800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-bthg8_5eefedc3-ac64-445a-84d3-5d1cb8a6dc45/manager/0.log" Jul 18 01:26:44.471108 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:44.471087 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-bthg8_5eefedc3-ac64-445a-84d3-5d1cb8a6dc45/copy-manifests/0.log" Jul 18 01:26:46.011384 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.011357 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z_bca1d201-80d5-4df9-aa51-cd4fab0ea09d/util/0.log" Jul 18 01:26:46.018112 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.018090 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z_bca1d201-80d5-4df9-aa51-cd4fab0ea09d/pull/0.log" Jul 18 01:26:46.024591 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.024561 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z_bca1d201-80d5-4df9-aa51-cd4fab0ea09d/extract/0.log" Jul 18 01:26:46.132242 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.132215 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj_d042e82d-b6f7-42cb-ad13-39fb6c20cdc9/extract/0.log" Jul 18 01:26:46.138367 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.138347 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj_d042e82d-b6f7-42cb-ad13-39fb6c20cdc9/util/0.log" Jul 18 01:26:46.145104 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.145080 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj_d042e82d-b6f7-42cb-ad13-39fb6c20cdc9/pull/0.log" Jul 18 01:26:46.253701 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.253674 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b_5ae727cb-2cb5-4e02-82bd-6ac4d41719e9/util/0.log" Jul 18 01:26:46.259584 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.259561 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b_5ae727cb-2cb5-4e02-82bd-6ac4d41719e9/pull/0.log" Jul 18 01:26:46.265491 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.265429 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b_5ae727cb-2cb5-4e02-82bd-6ac4d41719e9/extract/0.log" Jul 18 01:26:46.375518 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.375486 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst_93c7a470-9460-4b2e-a51c-17d12e4f264a/pull/0.log" Jul 18 01:26:46.380907 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.380884 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst_93c7a470-9460-4b2e-a51c-17d12e4f264a/extract/0.log" Jul 18 01:26:46.386327 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:46.386308 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst_93c7a470-9460-4b2e-a51c-17d12e4f264a/util/0.log" Jul 18 01:26:47.326219 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:47.326189 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lx7wp_fc6f8e2d-1f1b-4443-9d42-4611e90cc20b/manager/0.log" Jul 18 01:26:47.668857 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:47.668823 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678sqc8s_72128a42-1c6f-4cde-b0fe-d635a73cb47b/istio-proxy/0.log" Jul 18 01:26:47.792335 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:47.792308 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tlbs5_63a6f38f-262d-495f-9723-646c5441582a/discovery/0.log" Jul 18 01:26:48.928286 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:48.928249 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-65z55_cc7cf1d5-347f-4970-9b9d-a9d6f1c27f4f/main/0.log" Jul 18 01:26:49.145877 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:49.145843 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnzrvn_b0255c61-df1b-412e-917d-6fd85ffcedb2/main/0.log" Jul 18 01:26:57.545797 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:57.545762 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6xngz_22ca3617-ae2d-49ea-a5e8-42287275a957/global-pull-secret-syncer/0.log" Jul 18 01:26:57.732122 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:57.732089 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w8qlp_387b636d-e2b9-4dec-a8be-c03e24d54dfa/konnectivity-agent/0.log" Jul 18 01:26:57.797891 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:26:57.797806 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-101.ec2.internal_ded9cd7b6d6d15858bf2deecb597081d/haproxy/0.log" Jul 18 01:27:03.015213 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.015185 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z_bca1d201-80d5-4df9-aa51-cd4fab0ea09d/extract/0.log" Jul 18 01:27:03.038335 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.038305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z_bca1d201-80d5-4df9-aa51-cd4fab0ea09d/util/0.log" Jul 18 01:27:03.063389 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.063359 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sh62z_bca1d201-80d5-4df9-aa51-cd4fab0ea09d/pull/0.log" Jul 18 01:27:03.092412 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.092369 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj_d042e82d-b6f7-42cb-ad13-39fb6c20cdc9/extract/0.log" Jul 18 01:27:03.115419 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.115393 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj_d042e82d-b6f7-42cb-ad13-39fb6c20cdc9/util/0.log" Jul 18 01:27:03.142999 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.142963 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lrhdj_d042e82d-b6f7-42cb-ad13-39fb6c20cdc9/pull/0.log" Jul 18 01:27:03.178400 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.178367 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b_5ae727cb-2cb5-4e02-82bd-6ac4d41719e9/extract/0.log" Jul 18 01:27:03.199271 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.199230 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b_5ae727cb-2cb5-4e02-82bd-6ac4d41719e9/util/0.log" Jul 18 01:27:03.221261 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.221233 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7388r6b_5ae727cb-2cb5-4e02-82bd-6ac4d41719e9/pull/0.log" Jul 18 01:27:03.253925 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.253897 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst_93c7a470-9460-4b2e-a51c-17d12e4f264a/extract/0.log" Jul 18 01:27:03.280735 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.280650 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst_93c7a470-9460-4b2e-a51c-17d12e4f264a/util/0.log" Jul 18 01:27:03.303091 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.303060 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h6tst_93c7a470-9460-4b2e-a51c-17d12e4f264a/pull/0.log" Jul 18 01:27:03.960506 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:03.960473 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-lx7wp_fc6f8e2d-1f1b-4443-9d42-4611e90cc20b/manager/0.log" Jul 18 01:27:05.685107 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:05.685073 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a4c7a6e-de1a-47ce-8124-274155d5cf27/alertmanager/0.log" Jul 18 01:27:05.708942 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:05.708912 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a4c7a6e-de1a-47ce-8124-274155d5cf27/config-reloader/0.log" Jul 18 01:27:05.729745 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:05.729695 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a4c7a6e-de1a-47ce-8124-274155d5cf27/kube-rbac-proxy-web/0.log" Jul 18 01:27:05.751128 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:05.751102 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a4c7a6e-de1a-47ce-8124-274155d5cf27/kube-rbac-proxy/0.log" Jul 18 01:27:05.773256 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:05.773194 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a4c7a6e-de1a-47ce-8124-274155d5cf27/kube-rbac-proxy-metric/0.log" Jul 18 01:27:05.802809 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:05.802777 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a4c7a6e-de1a-47ce-8124-274155d5cf27/prom-label-proxy/0.log" Jul 18 01:27:05.823330 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:05.823300 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3a4c7a6e-de1a-47ce-8124-274155d5cf27/init-config-reloader/0.log" Jul 18 01:27:06.004949 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.004876 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-55wd8_d1531dd6-9366-4428-916d-941007be6433/monitoring-plugin/0.log" Jul 18 01:27:06.034889 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.034858 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxmrr_a9c4aa18-4287-47e5-a18e-1e18268b228e/node-exporter/0.log" Jul 18 01:27:06.052992 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.052962 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxmrr_a9c4aa18-4287-47e5-a18e-1e18268b228e/kube-rbac-proxy/0.log" Jul 18 01:27:06.071838 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.071803 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxmrr_a9c4aa18-4287-47e5-a18e-1e18268b228e/init-textfile/0.log" Jul 18 01:27:06.260006 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.259929 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-npnp9_82c4cd08-4ed6-4ff8-a126-5c20f4d08c06/kube-rbac-proxy-main/0.log" Jul 18 01:27:06.280035 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.279985 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-npnp9_82c4cd08-4ed6-4ff8-a126-5c20f4d08c06/kube-rbac-proxy-self/0.log" Jul 18 01:27:06.302237 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.302211 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-npnp9_82c4cd08-4ed6-4ff8-a126-5c20f4d08c06/openshift-state-metrics/0.log" Jul 18 01:27:06.498117 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.498090 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fthjp_a1997a68-235d-4663-a2b0-a8821897a4e2/prometheus-operator/0.log" Jul 18 01:27:06.514359 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.514269 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fthjp_a1997a68-235d-4663-a2b0-a8821897a4e2/kube-rbac-proxy/0.log" Jul 18 01:27:06.570913 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.570876 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756b75cfbb-dtg7q_da9e62b1-c6e1-40e1-a6cd-5988252a832d/telemeter-client/0.log" Jul 18 01:27:06.591318 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.591291 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756b75cfbb-dtg7q_da9e62b1-c6e1-40e1-a6cd-5988252a832d/reload/0.log" Jul 18 01:27:06.611038 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:06.610992 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-756b75cfbb-dtg7q_da9e62b1-c6e1-40e1-a6cd-5988252a832d/kube-rbac-proxy/0.log" Jul 18 01:27:07.759506 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.759473 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94"] Jul 18 01:27:07.759954 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.759916 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" Jul 18 01:27:07.759954 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.759935 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" Jul 18 01:27:07.759954 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.759951 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" Jul 18 01:27:07.760158 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.759961 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" Jul 18 01:27:07.760158 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.760058 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f901e70-8eeb-4ab1-8b08-db9d95e24106" containerName="istio-proxy" Jul 18 01:27:07.760158 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.760071 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" Jul 18 01:27:07.760158 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.760081 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f578078-3f61-4a93-9580-10a29577faf9" containerName="istio-proxy" Jul 18 01:27:07.760158 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.760090 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f92ffb-08eb-4096-8d2f-5ab9ab35260a" containerName="istio-proxy" Jul 18 01:27:07.763132 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.763116 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.765676 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.765658 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88kbb\"/\"default-dockercfg-2f44p\"" Jul 18 01:27:07.765810 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.765662 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88kbb\"/\"openshift-service-ca.crt\"" Jul 18 01:27:07.766381 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.766363 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88kbb\"/\"kube-root-ca.crt\"" Jul 18 01:27:07.772140 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.772116 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94"] Jul 18 01:27:07.868642 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.868601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-proc\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.868642 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.868645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v4r8\" (UniqueName: \"kubernetes.io/projected/f0679f03-0ad3-4489-878b-b6dce1c10bcd-kube-api-access-6v4r8\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.868863 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.868672 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-sys\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.868863 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.868690 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-podres\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.868863 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.868791 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-lib-modules\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969247 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-lib-modules\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969413 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-proc\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969413 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v4r8\" (UniqueName: \"kubernetes.io/projected/f0679f03-0ad3-4489-878b-b6dce1c10bcd-kube-api-access-6v4r8\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969413 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-sys\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969413 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-podres\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969596 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969415 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-lib-modules\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969596 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969430 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-proc\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969596 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969466 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-sys\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.969596 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.969500 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0679f03-0ad3-4489-878b-b6dce1c10bcd-podres\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:07.976708 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:07.976686 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v4r8\" (UniqueName: \"kubernetes.io/projected/f0679f03-0ad3-4489-878b-b6dce1c10bcd-kube-api-access-6v4r8\") pod \"perf-node-gather-daemonset-kdr94\" (UID: \"f0679f03-0ad3-4489-878b-b6dce1c10bcd\") " pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:08.074743 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:08.074654 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:08.209402 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:08.209380 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94"] Jul 18 01:27:08.211527 ip-10-0-133-101 kubenswrapper[2556]: W0718 01:27:08.211502 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0679f03_0ad3_4489_878b_b6dce1c10bcd.slice/crio-5d57f93e906fc40d7f67c155ab4bb78f85d4456ef25c82e5ea1609c7d28cbc25 WatchSource:0}: Error finding container 5d57f93e906fc40d7f67c155ab4bb78f85d4456ef25c82e5ea1609c7d28cbc25: Status 404 returned error can't find the container with id 5d57f93e906fc40d7f67c155ab4bb78f85d4456ef25c82e5ea1609c7d28cbc25 Jul 18 01:27:08.497259 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:08.497219 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" event={"ID":"f0679f03-0ad3-4489-878b-b6dce1c10bcd","Type":"ContainerStarted","Data":"40a71037d552f31f4643ae04b9efa034cc6cd7389706463d674b2db8dbc61622"} Jul 18 01:27:08.497518 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:08.497281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" event={"ID":"f0679f03-0ad3-4489-878b-b6dce1c10bcd","Type":"ContainerStarted","Data":"5d57f93e906fc40d7f67c155ab4bb78f85d4456ef25c82e5ea1609c7d28cbc25"} Jul 18 01:27:08.497518 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:08.497326 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:08.512681 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:08.512631 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" podStartSLOduration=1.5126152990000001 podStartE2EDuration="1.512615299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 01:27:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 01:27:08.511954733 +0000 UTC m=+1928.037718408" watchObservedRunningTime="2026-07-18 01:27:08.512615299 +0000 UTC m=+1928.038378974" Jul 18 01:27:10.592385 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:10.592356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqwfv_429d665b-3f33-48ac-b759-29a4e3faac27/dns/0.log" Jul 18 01:27:10.616104 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:10.616079 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bqwfv_429d665b-3f33-48ac-b759-29a4e3faac27/kube-rbac-proxy/0.log" Jul 18 01:27:10.733405 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:10.733374 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9sqfs_a6d5b666-4557-4d4f-a832-ba629e3d3496/dns-node-resolver/0.log" Jul 18 01:27:11.372639 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:11.372603 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5fc4b8c4d9-hb6f9_d8d57ad7-f36b-47b9-9e9b-837e2c852930/registry/0.log" Jul 18 01:27:11.394311 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:11.394282 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f58nz_dbb5603a-6e72-4433-b26c-8d6e4a2fec12/node-ca/0.log" Jul 18 01:27:12.340452 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:12.340422 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678sqc8s_72128a42-1c6f-4cde-b0fe-d635a73cb47b/istio-proxy/0.log" Jul 18 01:27:12.457641 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:12.457610 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tlbs5_63a6f38f-262d-495f-9723-646c5441582a/discovery/0.log" Jul 18 01:27:13.304605 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:13.304573 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9z2bf_aa025570-afe5-4a85-8d35-960b77280485/serve-healthcheck-canary/0.log" Jul 18 01:27:13.959925 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:13.959895 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tzsm5_324a1c33-e2d2-4345-97f0-02388e471bbc/kube-rbac-proxy/0.log" Jul 18 01:27:13.979684 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:13.979663 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tzsm5_324a1c33-e2d2-4345-97f0-02388e471bbc/exporter/0.log" Jul 18 01:27:14.002157 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:14.002128 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tzsm5_324a1c33-e2d2-4345-97f0-02388e471bbc/extractor/0.log" Jul 18 01:27:14.513086 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:14.513055 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88kbb/perf-node-gather-daemonset-kdr94" Jul 18 01:27:16.460761 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:16.460730 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-bthg8_5eefedc3-ac64-445a-84d3-5d1cb8a6dc45/manager/0.log" Jul 18 01:27:16.476646 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:16.476622 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84fdb8f5f6-bthg8_5eefedc3-ac64-445a-84d3-5d1cb8a6dc45/copy-manifests/0.log" Jul 18 01:27:18.031301 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:18.031216 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-fdb947fcf-hrpsx_470a6623-77ee-45ea-9715-d7b68ce52563/manager/0.log" Jul 18 01:27:18.569183 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:18.569158 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678sqc8s_72128a42-1c6f-4cde-b0fe-d635a73cb47b/istio-proxy/0.log" Jul 18 01:27:18.674894 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:18.674864 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tlbs5_63a6f38f-262d-495f-9723-646c5441582a/discovery/0.log" Jul 18 01:27:20.013097 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:20.013062 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678sqc8s_72128a42-1c6f-4cde-b0fe-d635a73cb47b/istio-proxy/0.log" Jul 18 01:27:20.124778 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:20.124745 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-tlbs5_63a6f38f-262d-495f-9723-646c5441582a/discovery/0.log" Jul 18 01:27:24.417434 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.417403 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5xxj_61a2caa5-a22c-4684-b0e6-c2c5eea956c5/kube-multus-additional-cni-plugins/0.log" Jul 18 01:27:24.438087 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.438059 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5xxj_61a2caa5-a22c-4684-b0e6-c2c5eea956c5/egress-router-binary-copy/0.log" Jul 18 01:27:24.458047 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.458004 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5xxj_61a2caa5-a22c-4684-b0e6-c2c5eea956c5/cni-plugins/0.log" Jul 18 01:27:24.481253 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.481232 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5xxj_61a2caa5-a22c-4684-b0e6-c2c5eea956c5/bond-cni-plugin/0.log" Jul 18 01:27:24.502066 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.502035 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5xxj_61a2caa5-a22c-4684-b0e6-c2c5eea956c5/routeoverride-cni/0.log" Jul 18 01:27:24.522401 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.522380 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5xxj_61a2caa5-a22c-4684-b0e6-c2c5eea956c5/whereabouts-cni-bincopy/0.log" Jul 18 01:27:24.542238 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.542208 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v5xxj_61a2caa5-a22c-4684-b0e6-c2c5eea956c5/whereabouts-cni/0.log" Jul 18 01:27:24.761876 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.761800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t7jcb_ccf3ebee-64b3-4301-89ce-1b4786aeb58e/kube-multus/0.log" Jul 18 01:27:24.805833 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.805805 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9fhcl_f01ef9a9-c90f-4009-8ae4-1c6dc5691867/network-metrics-daemon/0.log" Jul 18 01:27:24.823681 ip-10-0-133-101 kubenswrapper[2556]: I0718 01:27:24.823650 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9fhcl_f01ef9a9-c90f-4009-8ae4-1c6dc5691867/kube-rbac-proxy/0.log"