Jul 02 23:11:11.271806 ip-10-0-132-236 systemd[1]: Starting Kubernetes Kubelet... Jul 02 23:11:11.625581 ip-10-0-132-236 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:11:11.625581 ip-10-0-132-236 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 23:11:11.625581 ip-10-0-132-236 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:11:11.625581 ip-10-0-132-236 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 23:11:11.625581 ip-10-0-132-236 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 23:11:11.626955 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.626868 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 23:11:11.630704 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630682 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:11:11.630704 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630698 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:11:11.630704 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630704 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:11:11.630704 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630710 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630716 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630720 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630724 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630728 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630732 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630736 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630740 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630744 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630748 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630754 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630758 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630762 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630766 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630770 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630775 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630779 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630784 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630788 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630792 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:11:11.630957 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630796 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630800 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630804 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630808 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630811 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630815 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630819 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630823 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630827 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630831 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630836 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630841 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630845 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630849 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630854 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630860 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630864 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630870 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630874 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630878 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:11:11.631813 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630882 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630886 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630891 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630895 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630900 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630904 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630908 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630912 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630916 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630920 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630924 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630929 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630933 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630938 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630942 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630946 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630950 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630956 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630962 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630967 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:11:11.632712 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630971 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630976 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630980 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630985 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630989 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630993 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.630997 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631002 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631007 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631011 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631015 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631019 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631023 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631027 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631032 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631036 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631041 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631045 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631049 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:11:11.633541 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631053 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631058 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631062 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631067 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631072 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631083 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631088 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631092 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631096 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631102 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631107 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631111 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631116 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631121 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631125 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631129 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.631134 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632298 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632307 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:11:11.634332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632312 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632316 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632321 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632326 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632334 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632340 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632345 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632350 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632354 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632359 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632363 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632367 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632372 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632376 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632380 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632386 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632392 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632397 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632402 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:11:11.635225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632407 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632411 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632416 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632420 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632424 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632429 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632433 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632437 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632442 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632446 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632450 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632454 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632459 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632463 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632469 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632473 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632478 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632483 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632487 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:11:11.635892 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632493 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632499 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632504 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632507 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632532 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632536 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632540 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632543 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632547 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632552 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632557 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632561 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632565 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632569 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632573 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632578 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632582 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632586 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632591 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632595 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:11:11.636691 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632599 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632603 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632608 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632613 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632617 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632621 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632627 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632631 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632635 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632640 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632645 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632650 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632654 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632658 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632663 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632667 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632671 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632676 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632681 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632686 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:11:11.637183 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632691 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632695 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632699 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632703 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632707 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632712 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632716 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632720 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632724 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632728 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632732 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632737 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632741 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632746 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632750 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632755 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632760 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632764 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.632768 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633372 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:11:11.637787 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633379 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633384 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633388 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633393 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633397 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633402 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633406 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633411 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633415 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633419 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633423 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633427 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633432 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633436 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633440 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633444 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633449 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633453 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633457 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633462 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:11:11.638290 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633466 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633471 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633475 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633479 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633483 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633487 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633492 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633496 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633501 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633505 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633529 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633534 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633538 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633542 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633546 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633550 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633555 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633560 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633564 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633569 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:11:11.638789 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633573 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633577 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633581 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633585 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633590 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633594 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633598 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633603 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633607 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633611 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633615 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633619 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633625 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633632 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633638 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633643 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633648 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633652 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633658 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:11:11.639275 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633663 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633667 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633672 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633676 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633680 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633686 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633691 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633696 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633700 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633705 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633710 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633714 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633718 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633723 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633727 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633731 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633735 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633739 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633744 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:11:11.639762 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633750 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633757 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633762 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633766 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633771 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633775 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633780 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633784 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633791 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633795 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633799 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633803 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633807 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633812 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633816 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633820 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633824 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633829 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633833 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.633837 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:11:11.640225 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633940 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633950 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633959 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633966 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633975 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633981 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633987 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633994 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.633999 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634004 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634010 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634015 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634020 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634025 2578 flags.go:64] FLAG: --cgroup-root="" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634030 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634034 2578 flags.go:64] FLAG: --client-ca-file="" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634039 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634044 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634052 2578 flags.go:64] FLAG: --cluster-domain="" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634057 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634064 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634069 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634074 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634080 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 23:11:11.640786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634085 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634090 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634095 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634100 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634105 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634110 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634115 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634120 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634126 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634131 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634136 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634141 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634146 2578 flags.go:64] FLAG: --enable-server="true" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634151 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634159 2578 flags.go:64] FLAG: --event-burst="100" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634164 2578 flags.go:64] FLAG: --event-qps="50" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634169 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634173 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634179 2578 flags.go:64] FLAG: --eviction-hard="" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634185 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634190 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634195 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634200 2578 flags.go:64] FLAG: --eviction-soft="" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634205 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634209 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 23:11:11.641363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634214 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634218 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634223 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634230 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634234 2578 flags.go:64] FLAG: --feature-gates="" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634241 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634246 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634251 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634255 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634261 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634266 2578 flags.go:64] FLAG: --help="false" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634270 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-132-236.ec2.internal" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634275 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634280 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634285 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634290 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634296 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634300 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634305 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634310 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634314 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634320 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634325 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634330 2578 flags.go:64] FLAG: --kube-reserved="" Jul 02 23:11:11.642024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634334 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634339 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634343 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634347 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634352 2578 flags.go:64] FLAG: --lock-file="" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634356 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634361 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634367 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634376 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634381 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634385 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634392 2578 flags.go:64] FLAG: --logging-format="text" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634396 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634402 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634408 2578 flags.go:64] FLAG: --manifest-url="" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634412 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634419 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634424 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634431 2578 flags.go:64] FLAG: --max-pods="110" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634435 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634440 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634444 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634449 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634454 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634459 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 23:11:11.642620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634464 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634475 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634480 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634485 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634490 2578 flags.go:64] FLAG: --pod-cidr="" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634495 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634504 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634527 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634536 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634541 2578 flags.go:64] FLAG: --port="10250" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634545 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634550 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-069f60f786d9158e8" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634555 2578 flags.go:64] FLAG: --qos-reserved="" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634560 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634565 2578 flags.go:64] FLAG: --register-node="true" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634569 2578 flags.go:64] FLAG: --register-with-taints="" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634575 2578 flags.go:64] FLAG: --registry-burst="10" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634580 2578 flags.go:64] FLAG: --registry-qps="5" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634584 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634592 2578 flags.go:64] FLAG: --reserved-memory="" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634598 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634603 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634608 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634613 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634618 2578 flags.go:64] FLAG: --runonce="false" Jul 02 23:11:11.643242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634623 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634628 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634633 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634638 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634643 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634648 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634653 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634658 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634663 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634667 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634672 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634677 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634681 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634687 2578 flags.go:64] FLAG: --system-cgroups="" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634692 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634702 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634707 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634711 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634718 2578 flags.go:64] FLAG: --tls-min-version="" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634722 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634728 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634733 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634739 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634744 2578 flags.go:64] FLAG: --v="2" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634750 2578 flags.go:64] FLAG: --version="false" Jul 02 23:11:11.644011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634756 2578 flags.go:64] FLAG: --vmodule="" Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634763 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.634769 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634948 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634955 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634960 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634965 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634973 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634979 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634984 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634989 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634994 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.634998 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635002 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635006 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635011 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635015 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635019 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635024 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635028 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:11:11.645029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635032 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635038 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635044 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635048 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635052 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635056 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635060 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635065 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635069 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635073 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635086 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635090 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635095 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635101 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635105 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635110 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635114 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635119 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:11:11.645590 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635125 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635131 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635136 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635140 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635147 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635153 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635157 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635161 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635166 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635170 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635175 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635179 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635183 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635187 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635191 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635196 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635203 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635207 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635212 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635216 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:11:11.646072 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635220 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635224 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635227 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635231 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635235 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635239 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635243 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635249 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635253 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635257 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635261 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635265 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635269 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635274 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635278 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635282 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635286 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635290 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635294 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635298 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:11:11.646609 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635302 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635306 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635310 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635314 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635318 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635322 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635327 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635331 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635337 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635342 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635346 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635350 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635354 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635359 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635363 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635367 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635371 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635375 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635379 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:11:11.647110 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635385 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635389 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635394 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635398 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.635403 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.635411 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.642066 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.642080 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.642620 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.642627 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642696 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642701 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642704 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642707 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642710 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:11:11.647593 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642713 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642715 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642718 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642720 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642723 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642726 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642728 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642731 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642733 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642736 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642738 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642741 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642743 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642746 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642748 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642751 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642753 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642756 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642758 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642761 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:11:11.647965 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642763 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642766 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642769 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642771 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642776 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642779 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642783 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642787 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642790 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642793 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642796 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642799 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642802 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642805 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642808 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642810 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642813 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642816 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642818 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:11:11.648442 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642821 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642823 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642826 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642828 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642831 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642833 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642836 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642839 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642843 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642846 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642849 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642852 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642854 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642857 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642859 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642862 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642865 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642868 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642871 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:11:11.648979 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642874 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642876 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642879 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642882 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642884 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642887 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642890 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642892 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642895 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642897 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642900 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642902 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642905 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642907 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642910 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642913 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642915 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642918 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642920 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642923 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:11:11.649473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642925 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642928 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642931 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642934 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642938 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642941 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642944 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642947 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642950 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642953 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642956 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642958 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642962 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642964 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642967 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:11:11.649978 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.642969 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.642974 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643103 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643109 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643112 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643115 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643117 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643120 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643123 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643126 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643129 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643131 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643134 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643138 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 23:11:11.650341 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643141 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643144 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643148 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643152 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643154 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643157 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643159 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643162 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643165 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643167 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643170 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643172 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643175 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643178 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643180 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643183 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643186 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643188 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643191 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 23:11:11.650706 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643193 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643195 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643198 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643200 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643203 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643205 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643208 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643210 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643213 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643215 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643217 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643220 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643222 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643225 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643227 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643230 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643232 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643235 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643237 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643239 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 23:11:11.651176 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643242 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643244 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643247 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643250 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643253 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643256 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643258 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643261 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643263 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643266 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643269 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643271 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643274 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643277 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643279 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643282 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643284 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643286 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643289 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643291 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 23:11:11.651678 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643293 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643296 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643298 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643301 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643303 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643305 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643308 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643311 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643315 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643318 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643320 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643323 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643325 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643329 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643331 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643334 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643337 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643340 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643343 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643345 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 23:11:11.652154 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643348 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643351 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643353 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643356 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643359 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643362 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643365 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:11.643367 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.643372 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.643501 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.646387 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.647655 2578 server.go:1019] "Starting client certificate rotation" Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.647759 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 23:11:11.652851 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.647797 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 23:11:11.653173 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.649584 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 23:11:11.653173 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.650720 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 23:11:11.658312 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.658296 2578 log.go:25] "Validated CRI v1 runtime API" Jul 02 23:11:11.661777 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.661762 2578 log.go:25] "Validated CRI v1 image API" Jul 02 23:11:11.662630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.662615 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 23:11:11.665424 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.665396 2578 fs.go:135] Filesystem UUIDs: map[092da6e7-4aa5-4d24-8942-2530da3a7abf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7d0b432b-90c6-4706-a6c9-012dab60a128:/dev/nvme0n1p4] Jul 02 23:11:11.665494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.665422 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 23:11:11.670932 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.670816 2578 manager.go:216] Machine: {Timestamp:2026-07-02 23:11:11.669018087 +0000 UTC m=+0.290599313 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093836 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec293bc210c6e932c68522531a6f4ba0 SystemUUID:ec293bc2-10c6-e932-c685-22531a6f4ba0 BootID:7b3f535e-fe18-4a52-8f2d-021a7c8862d7 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:6a:96:34:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:6a:96:34:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:06:ca:f4:c1:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 23:11:11.670932 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.670925 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 23:11:11.671107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.671033 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 23:11:11.673413 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.673390 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 23:11:11.673567 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.673415 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 23:11:11.674005 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.673996 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 23:11:11.674039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.674008 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 23:11:11.674039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.674015 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 23:11:11.674580 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.674570 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 23:11:11.675609 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.675598 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 23:11:11.677949 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.677932 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 23:11:11.678064 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678052 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 02 23:11:11.678181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678171 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 23:11:11.678229 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678203 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 02 23:11:11.678229 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678213 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 23:11:11.678229 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678226 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 23:11:11.678353 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678238 2578 kubelet.go:398] "Adding apiserver pod source" Jul 02 23:11:11.678353 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678247 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 23:11:11.678628 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678616 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 23:11:11.678673 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.678634 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 23:11:11.681366 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.681277 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 23:11:11.683214 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.683195 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 23:11:11.683280 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.683230 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 23:11:11.685042 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685028 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 23:11:11.685078 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685055 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 23:11:11.685078 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685066 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 23:11:11.685078 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685075 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685088 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685097 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685110 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685118 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685128 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685137 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685150 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 23:11:11.685159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685158 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 23:11:11.685755 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685744 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 23:11:11.685786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.685758 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 23:11:11.688710 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.688689 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 23:11:11.688783 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.688692 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 23:11:11.688843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.688824 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 23:11:11.689137 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.689124 2578 server.go:1268] "Started kubelet" Jul 02 23:11:11.689228 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.689182 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 23:11:11.689344 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.689270 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 23:11:11.689400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.689368 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 23:11:11.690289 ip-10-0-132-236 systemd[1]: Started Kubernetes Kubelet. Jul 02 23:11:11.690407 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.690374 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 02 23:11:11.691175 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.691127 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 23:11:11.694847 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.694818 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 23:11:11.696980 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.696240 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-236.ec2.internal.18be9bdc00849675 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-236.ec2.internal,UID:ip-10-0-132-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-236.ec2.internal,},FirstTimestamp:2026-07-02 23:11:11.689094773 +0000 UTC m=+0.310676000,LastTimestamp:2026-07-02 23:11:11.689094773 +0000 UTC m=+0.310676000,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-236.ec2.internal,}" Jul 02 23:11:11.698508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.698493 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 23:11:11.698643 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.698500 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 23:11:11.698734 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.698656 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:11.698987 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.698965 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 23:11:11.698987 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.698988 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 23:11:11.699142 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699051 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 23:11:11.699142 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699125 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 02 23:11:11.699142 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699133 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 02 23:11:11.699529 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699493 2578 factory.go:55] Registering systemd factory Jul 02 23:11:11.699529 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699528 2578 factory.go:223] Registration of the systemd container factory successfully Jul 02 23:11:11.699737 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699724 2578 factory.go:153] Registering CRI-O factory Jul 02 23:11:11.699774 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699740 2578 factory.go:223] Registration of the crio container factory successfully Jul 02 23:11:11.699802 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699783 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 23:11:11.699848 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699803 2578 factory.go:103] Registering Raw factory Jul 02 23:11:11.699848 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.699813 2578 manager.go:1196] Started watching for new ooms in manager Jul 02 23:11:11.700370 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.700358 2578 manager.go:349] Starting recovery of all containers Jul 02 23:11:11.700802 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.700774 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9c6lt" Jul 02 23:11:11.701475 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.701451 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 23:11:11.701586 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.701482 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 23:11:11.708584 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.708525 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9c6lt" Jul 02 23:11:11.714025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.713218 2578 manager.go:354] Recovery completed Jul 02 23:11:11.720212 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.720197 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:11:11.722581 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.722561 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:11:11.722662 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.722600 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:11:11.722662 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.722615 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:11:11.723970 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.723949 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 23:11:11.723970 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.723968 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 23:11:11.724069 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.723986 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 02 23:11:11.724101 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.723970 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:11:11.724881 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.724865 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:11:11.724956 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.724901 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:11:11.724956 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.724916 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:11:11.725052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.724969 2578 policy_none.go:49] "None policy: Start" Jul 02 23:11:11.725052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.724984 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 23:11:11.725052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.724998 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 23:11:11.725233 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.725127 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-236.ec2.internal.18be9bdc02838d1e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-236.ec2.internal,UID:ip-10-0-132-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-236.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-236.ec2.internal,},FirstTimestamp:2026-07-02 23:11:11.722581278 +0000 UTC m=+0.344162507,LastTimestamp:2026-07-02 23:11:11.722581278 +0000 UTC m=+0.344162507,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-236.ec2.internal,}" Jul 02 23:11:11.725888 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.725876 2578 policy_none.go:47] "Start" Jul 02 23:11:11.765067 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.765053 2578 manager.go:337] "Starting Device Plugin manager" Jul 02 23:11:11.765166 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.765084 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 23:11:11.765166 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.765093 2578 server.go:87] "Starting device plugin registration server" Jul 02 23:11:11.765334 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.765322 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 23:11:11.765378 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.765334 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 23:11:11.765448 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.765425 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 23:11:11.765577 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.765507 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 23:11:11.765577 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.765538 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 23:11:11.766063 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.766046 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 23:11:11.766149 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.766089 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:11.864998 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.864959 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.865526 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.866312 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.866350 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.866376 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.866417 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.866422 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.866450 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.866466 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:11:11.867034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.866500 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-236.ec2.internal" Jul 02 23:11:11.868920 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.868903 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:11:11.874899 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.874883 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-236.ec2.internal" Jul 02 23:11:11.874972 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.874907 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-236.ec2.internal\": node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:11.933546 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.933453 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:11.966500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.966469 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal"] Jul 02 23:11:11.966580 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.966562 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:11:11.967539 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.967509 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:11:11.967634 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.967554 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:11:11.967634 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.967569 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:11:11.969960 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.969947 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:11:11.970079 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:11.970115 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970096 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:11:11.970681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970664 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:11:11.970794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970680 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:11:11.970794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970700 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:11:11.970794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970706 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:11:11.970794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970713 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:11:11.970794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.970722 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:11:11.972770 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.972755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" Jul 02 23:11:11.972831 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.972781 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 23:11:11.973504 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.973475 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientMemory" Jul 02 23:11:11.973504 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.973495 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 23:11:11.973660 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:11.973508 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeHasSufficientPID" Jul 02 23:11:11.998030 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:11.998013 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-236.ec2.internal\" not found" node="ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.000494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.000471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/505b89dd4f29cd1d6366a8221bca889f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal\" (UID: \"505b89dd4f29cd1d6366a8221bca889f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.000590 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.000506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18bcd73158ca1a5b1c82fc4d26d8e309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-236.ec2.internal\" (UID: \"18bcd73158ca1a5b1c82fc4d26d8e309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.000590 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.000561 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/505b89dd4f29cd1d6366a8221bca889f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal\" (UID: \"505b89dd4f29cd1d6366a8221bca889f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.002245 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.002228 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-236.ec2.internal\" not found" node="ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.034099 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.034080 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:12.101328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.101304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/505b89dd4f29cd1d6366a8221bca889f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal\" (UID: \"505b89dd4f29cd1d6366a8221bca889f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.101429 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.101333 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/505b89dd4f29cd1d6366a8221bca889f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal\" (UID: \"505b89dd4f29cd1d6366a8221bca889f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.101429 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.101357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18bcd73158ca1a5b1c82fc4d26d8e309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-236.ec2.internal\" (UID: \"18bcd73158ca1a5b1c82fc4d26d8e309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.101429 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.101393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/505b89dd4f29cd1d6366a8221bca889f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal\" (UID: \"505b89dd4f29cd1d6366a8221bca889f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.101429 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.101418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18bcd73158ca1a5b1c82fc4d26d8e309-config\") pod \"kube-apiserver-proxy-ip-10-0-132-236.ec2.internal\" (UID: \"18bcd73158ca1a5b1c82fc4d26d8e309\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.101575 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.101411 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/505b89dd4f29cd1d6366a8221bca889f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal\" (UID: \"505b89dd4f29cd1d6366a8221bca889f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.134396 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.134375 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:12.234634 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.234570 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:12.299777 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.299741 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.305222 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.305074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" Jul 02 23:11:12.335073 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.335049 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:12.435603 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.435552 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:12.536073 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.536007 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:12.636476 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.636440 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:12.647607 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.647586 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 23:11:12.647733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.647716 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 23:11:12.716262 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.716229 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 23:06:12 +0000 UTC" deadline="2028-04-14 16:17:16.182715598 +0000 UTC" Jul 02 23:11:12.716262 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:12.716255 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15641h6m3.466464171s" Jul 02 23:11:12.737400 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:12.737373 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:13.980431 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:13.980403 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:14.080743 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.080715 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:14.084005 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.083987 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:11:14.140611 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:14.140567 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505b89dd4f29cd1d6366a8221bca889f.slice/crio-686311e3db2bfaac3d748f93fa52f97e6bcc044deb4d1befbaa2cdd634d9ea43 WatchSource:0}: Error finding container 686311e3db2bfaac3d748f93fa52f97e6bcc044deb4d1befbaa2cdd634d9ea43: Status 404 returned error can't find the container with id 686311e3db2bfaac3d748f93fa52f97e6bcc044deb4d1befbaa2cdd634d9ea43 Jul 02 23:11:14.141383 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:14.141360 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bcd73158ca1a5b1c82fc4d26d8e309.slice/crio-b1b3702310b87d11f2edc4c38b9de5f0855b284e0a04ef567915d3c4721899a7 WatchSource:0}: Error finding container b1b3702310b87d11f2edc4c38b9de5f0855b284e0a04ef567915d3c4721899a7: Status 404 returned error can't find the container with id b1b3702310b87d11f2edc4c38b9de5f0855b284e0a04ef567915d3c4721899a7 Jul 02 23:11:14.147359 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.147344 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:11:14.181479 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.181431 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:14.282000 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.281934 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-236.ec2.internal\" not found" Jul 02 23:11:14.320729 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.320708 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:11:14.341529 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.341507 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" Jul 02 23:11:14.364702 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.364678 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:11:14.368702 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.368687 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" Jul 02 23:11:14.385527 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.385509 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 23:11:14.437992 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.437975 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:11:14.762038 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.761965 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 23:11:14.822178 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.822145 2578 apiserver.go:52] "Watching apiserver" Jul 02 23:11:14.830620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.830579 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 23:11:14.831326 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.831304 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-5v4sd","kube-system/konnectivity-agent-5ps4z","openshift-dns/node-resolver-qvk4m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal","openshift-multus/multus-additional-cni-plugins-4mwlf","openshift-network-diagnostics/network-check-target-ffbbz","openshift-network-operator/iptables-alerter-8d6ff","kube-system/global-pull-secret-syncer-wvx8s","kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt","openshift-cluster-node-tuning-operator/tuned-gk9sr","openshift-image-registry/node-ca-vvr6x","openshift-multus/multus-6442c","openshift-multus/network-metrics-daemon-zpnlm"] Jul 02 23:11:14.834059 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.834035 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.836671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.836635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 23:11:14.836671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.836649 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8m6js\"" Jul 02 23:11:14.836845 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.836831 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.836920 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.836832 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.837697 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.837331 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6442c" Jul 02 23:11:14.839362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.839341 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h5ttn\"" Jul 02 23:11:14.839458 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.839353 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.839519 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.839489 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 23:11:14.839714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.839696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.839776 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.839719 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 23:11:14.839943 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.839923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.841153 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.841140 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 23:11:14.842280 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.842263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4v6fh\"" Jul 02 23:11:14.842377 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.842337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:14.842440 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.842409 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:14.842546 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.842530 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.842631 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.842612 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.844291 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.844275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.846473 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.846312 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 23:11:14.846565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.846551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:14.846635 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.846612 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:14.847093 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.847076 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s46rg\"" Jul 02 23:11:14.847670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.847652 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 23:11:14.848707 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.848690 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:14.848796 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.848764 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:14.851281 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.851262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:14.853039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.852791 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 23:11:14.853039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.852874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.853039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.852942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-tmp-dir\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.853039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.852964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n4x8\" (UniqueName: \"kubernetes.io/projected/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-kube-api-access-9n4x8\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.853039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-socket-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77bw2\" (UniqueName: \"kubernetes.io/projected/e4a2477b-4712-49f9-995d-4bf0d7f98213-kube-api-access-77bw2\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853142 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-cni-bin\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-etc-kubernetes\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853233 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-system-cni-dir\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-cnibin\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-cni-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853302 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-cni-binary-copy\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-multus-certs\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-hosts-file\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-device-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwv7v\" (UniqueName: \"kubernetes.io/projected/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-kube-api-access-nwv7v\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:14.853753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-registration-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-etc-selinux\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-k8s-cni-cncf-io\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-netns\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-hostroot\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-conf-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-socket-dir-parent\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-cni-multus\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.853981 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-kubelet\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854014 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggqmv\" (UniqueName: \"kubernetes.io/projected/49f96f1f-ac38-4d3e-b171-00c95352ec56-kube-api-access-ggqmv\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-os-release\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854055 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tscx7\"" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854078 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854064 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwbc\" (UniqueName: \"kubernetes.io/projected/17aaa165-6fc7-48c2-9e48-4886fe694b80-kube-api-access-cjwbc\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-system-cni-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854213 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-sys-fs\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.857600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-cnibin\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-os-release\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-daemon-config\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854444 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.854448 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.856275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.856843 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.856845 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 23:11:14.858467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.857295 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fpnsn\"" Jul 02 23:11:14.858827 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.858631 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 23:11:14.858986 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.858964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.859747 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.859502 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 23:11:14.859747 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.859592 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 23:11:14.859747 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.859505 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.860015 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.859854 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.860015 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.859930 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n9hnj\"" Jul 02 23:11:14.861063 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.861044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:14.863506 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.863488 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 23:11:14.863818 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.863800 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.863921 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.863853 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 23:11:14.864295 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.864073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.867912 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.865702 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 23:11:14.867912 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.866571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 23:11:14.867912 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.866648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r6spk\"" Jul 02 23:11:14.867912 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.867196 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w4clk\"" Jul 02 23:11:14.882561 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.882539 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s42f9" Jul 02 23:11:14.893708 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.893687 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s42f9" Jul 02 23:11:14.943188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.943155 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 23:11:14.955308 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n4x8\" (UniqueName: \"kubernetes.io/projected/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-kube-api-access-9n4x8\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.955469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.955469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-kubernetes\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.955469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6d9s\" (UniqueName: \"kubernetes.io/projected/afab4908-5205-4800-8d18-32ba6c9c1241-kube-api-access-s6d9s\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:14.955469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-cni-netd\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.955469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955450 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77bw2\" (UniqueName: \"kubernetes.io/projected/e4a2477b-4712-49f9-995d-4bf0d7f98213-kube-api-access-77bw2\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-sys\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-cni-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-cni-binary-copy\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-multus-certs\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-hosts-file\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-device-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.955714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1b075e-22f0-4617-a454-240bc9d78be8-tmp\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c000021-9827-44c9-bc41-7455ba95f79e-konnectivity-ca\") pod \"konnectivity-agent-5ps4z\" (UID: \"2c000021-9827-44c9-bc41-7455ba95f79e\") " pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-cni-bin\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955804 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gxxz\" (UniqueName: \"kubernetes.io/projected/6b0a7a84-add5-486e-9927-acd6c716246c-kube-api-access-2gxxz\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.955841 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955858 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwbc\" (UniqueName: \"kubernetes.io/projected/17aaa165-6fc7-48c2-9e48-4886fe694b80-kube-api-access-cjwbc\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955904 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysctl-conf\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:14.955920 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs podName:49f96f1f-ac38-4d3e-b171-00c95352ec56 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:15.455900263 +0000 UTC m=+2.935113004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs") pod "network-metrics-daemon-zpnlm" (UID: "49f96f1f-ac38-4d3e-b171-00c95352ec56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955942 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-systemd\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-multus-certs\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955969 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-registration-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.955997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-k8s-cni-cncf-io\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-hosts-file\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956020 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-cni-binary-copy\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b0a7a84-add5-486e-9927-acd6c716246c-ovn-node-metrics-cert\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-registration-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-cni-multus\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-kubelet\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggqmv\" (UniqueName: \"kubernetes.io/projected/49f96f1f-ac38-4d3e-b171-00c95352ec56-kube-api-access-ggqmv\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-modprobe-d\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-cni-multus\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956343 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-k8s-cni-cncf-io\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956388 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-device-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-kubelet\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hctz6\" (UniqueName: \"kubernetes.io/projected/ba1b075e-22f0-4617-a454-240bc9d78be8-kube-api-access-hctz6\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-cni-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956526 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-var-lib-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-ovnkube-script-lib\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-run-netns\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956643 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956656 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956688 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-log-socket\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.956948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-host\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-os-release\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956821 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956914 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-os-release\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-run\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956964 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-var-lib-kubelet\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.956989 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afab4908-5205-4800-8d18-32ba6c9c1241-iptables-alerter-script\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afab4908-5205-4800-8d18-32ba6c9c1241-host-slash\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-tmp-dir\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957117 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-lib-modules\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957141 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-socket-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-cni-bin\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-etc-kubernetes\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.957733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-system-cni-dir\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-cnibin\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-systemd-units\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-etc-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957375 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-var-lib-cni-bin\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957380 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957387 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-tmp-dir\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysconfig\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957442 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-node-log\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysctl-d\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957506 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-etc-kubernetes\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-tuned\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957476 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-cnibin\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-system-cni-dir\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-socket-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/17aaa165-6fc7-48c2-9e48-4886fe694b80-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.958565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-slash\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957618 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-os-release\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwv7v\" (UniqueName: \"kubernetes.io/projected/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-kube-api-access-nwv7v\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-etc-selinux\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957716 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-netns\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/17aaa165-6fc7-48c2-9e48-4886fe694b80-os-release\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-hostroot\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957757 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-conf-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957797 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-systemd\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-host-run-netns\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-socket-dir-parent\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957830 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-etc-selinux\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-conf-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a38af0d-67d8-4b5f-bdaf-338dd91be602-kubelet-config\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-hostroot\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.959355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957900 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c000021-9827-44c9-bc41-7455ba95f79e-agent-certs\") pod \"konnectivity-agent-5ps4z\" (UID: \"2c000021-9827-44c9-bc41-7455ba95f79e\") " pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-socket-dir-parent\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-kubelet\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-ovn\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.957984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-serviceca\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958010 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4jgq\" (UniqueName: \"kubernetes.io/projected/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-kube-api-access-r4jgq\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958038 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-system-cni-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-host\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958081 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-ovnkube-config\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958105 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-env-overrides\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-system-cni-dir\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-sys-fs\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958161 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-cnibin\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958172 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4a2477b-4712-49f9-995d-4bf0d7f98213-sys-fs\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-daemon-config\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a38af0d-67d8-4b5f-bdaf-338dd91be602-dbus\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-cnibin\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.960130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.958676 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-multus-daemon-config\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.964021 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.964000 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 23:11:14.968373 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.968293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n4x8\" (UniqueName: \"kubernetes.io/projected/cb215e73-0ebf-455c-8c7a-7e18ab49c45d-kube-api-access-9n4x8\") pod \"node-resolver-qvk4m\" (UID: \"cb215e73-0ebf-455c-8c7a-7e18ab49c45d\") " pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:14.970659 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.970637 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggqmv\" (UniqueName: \"kubernetes.io/projected/49f96f1f-ac38-4d3e-b171-00c95352ec56-kube-api-access-ggqmv\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:14.970766 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.970680 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77bw2\" (UniqueName: \"kubernetes.io/projected/e4a2477b-4712-49f9-995d-4bf0d7f98213-kube-api-access-77bw2\") pod \"aws-ebs-csi-driver-node-7g6qt\" (UID: \"e4a2477b-4712-49f9-995d-4bf0d7f98213\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:14.971142 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.971117 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwv7v\" (UniqueName: \"kubernetes.io/projected/a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d-kube-api-access-nwv7v\") pod \"multus-6442c\" (UID: \"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d\") " pod="openshift-multus/multus-6442c" Jul 02 23:11:14.972425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:14.972406 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwbc\" (UniqueName: \"kubernetes.io/projected/17aaa165-6fc7-48c2-9e48-4886fe694b80-kube-api-access-cjwbc\") pod \"multus-additional-cni-plugins-4mwlf\" (UID: \"17aaa165-6fc7-48c2-9e48-4886fe694b80\") " pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:15.014932 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.014811 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" event={"ID":"18bcd73158ca1a5b1c82fc4d26d8e309","Type":"ContainerStarted","Data":"b1b3702310b87d11f2edc4c38b9de5f0855b284e0a04ef567915d3c4721899a7"} Jul 02 23:11:15.016164 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.016139 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" event={"ID":"505b89dd4f29cd1d6366a8221bca889f","Type":"ContainerStarted","Data":"686311e3db2bfaac3d748f93fa52f97e6bcc044deb4d1befbaa2cdd634d9ea43"} Jul 02 23:11:15.058947 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.058917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-modprobe-d\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.058947 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.058950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hctz6\" (UniqueName: \"kubernetes.io/projected/ba1b075e-22f0-4617-a454-240bc9d78be8-kube-api-access-hctz6\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.058947 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.058967 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-var-lib-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.058983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-ovnkube-script-lib\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-run-netns\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-log-socket\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-host\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-run\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-var-lib-kubelet\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.059196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afab4908-5205-4800-8d18-32ba6c9c1241-iptables-alerter-script\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afab4908-5205-4800-8d18-32ba6c9c1241-host-slash\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-lib-modules\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-systemd-units\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-etc-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059349 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-modprobe-d\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysconfig\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-var-lib-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-node-log\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysctl-d\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-tuned\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.059489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-slash\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-systemd\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a38af0d-67d8-4b5f-bdaf-338dd91be602-kubelet-config\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c000021-9827-44c9-bc41-7455ba95f79e-agent-certs\") pod \"konnectivity-agent-5ps4z\" (UID: \"2c000021-9827-44c9-bc41-7455ba95f79e\") " pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-kubelet\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-ovnkube-script-lib\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-run-ovn-kubernetes\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059676 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-ovn\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059696 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-run-netns\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059713 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afab4908-5205-4800-8d18-32ba6c9c1241-host-slash\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.059718 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059627 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-ovn\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-serviceca\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.059771 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret podName:7a38af0d-67d8-4b5f-bdaf-338dd91be602 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:15.559753932 +0000 UTC m=+3.038966697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret") pod "global-pull-secret-syncer-wvx8s" (UID: "7a38af0d-67d8-4b5f-bdaf-338dd91be602") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059774 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-log-socket\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059804 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4jgq\" (UniqueName: \"kubernetes.io/projected/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-kube-api-access-r4jgq\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:15.059874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-host\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-systemd-units\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-ovnkube-config\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059906 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-env-overrides\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a38af0d-67d8-4b5f-bdaf-338dd91be602-dbus\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059962 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-kubernetes\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-run-systemd\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-host\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysconfig\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-kubelet\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060053 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7a38af0d-67d8-4b5f-bdaf-338dd91be602-kubelet-config\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-node-log\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-run\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-var-lib-kubelet\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-serviceca\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysctl-d\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060229 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-slash\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.060425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060236 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-kubernetes\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7a38af0d-67d8-4b5f-bdaf-338dd91be602-dbus\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-lib-modules\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059905 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-etc-openvswitch\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afab4908-5205-4800-8d18-32ba6c9c1241-iptables-alerter-script\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059985 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6d9s\" (UniqueName: \"kubernetes.io/projected/afab4908-5205-4800-8d18-32ba6c9c1241-kube-api-access-s6d9s\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-cni-netd\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-cni-netd\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-sys\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1b075e-22f0-4617-a454-240bc9d78be8-tmp\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-sys\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060479 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-env-overrides\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c000021-9827-44c9-bc41-7455ba95f79e-konnectivity-ca\") pod \"konnectivity-agent-5ps4z\" (UID: \"2c000021-9827-44c9-bc41-7455ba95f79e\") " pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-cni-bin\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gxxz\" (UniqueName: \"kubernetes.io/projected/6b0a7a84-add5-486e-9927-acd6c716246c-kube-api-access-2gxxz\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysctl-conf\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-systemd\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b0a7a84-add5-486e-9927-acd6c716246c-ovn-node-metrics-cert\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.061420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b0a7a84-add5-486e-9927-acd6c716246c-ovnkube-config\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.062328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-sysctl-conf\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.062328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.059838 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-host\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:15.062328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c000021-9827-44c9-bc41-7455ba95f79e-konnectivity-ca\") pod \"konnectivity-agent-5ps4z\" (UID: \"2c000021-9827-44c9-bc41-7455ba95f79e\") " pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:15.062328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.060974 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-systemd\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.062328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.061018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b0a7a84-add5-486e-9927-acd6c716246c-host-cni-bin\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.062982 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.062959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1b075e-22f0-4617-a454-240bc9d78be8-tmp\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.063106 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.063026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ba1b075e-22f0-4617-a454-240bc9d78be8-etc-tuned\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.063178 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.063158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b0a7a84-add5-486e-9927-acd6c716246c-ovn-node-metrics-cert\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.063292 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.063213 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c000021-9827-44c9-bc41-7455ba95f79e-agent-certs\") pod \"konnectivity-agent-5ps4z\" (UID: \"2c000021-9827-44c9-bc41-7455ba95f79e\") " pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:15.070994 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.070617 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:11:15.070994 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.070644 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:11:15.070994 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.070658 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xgqt2 for pod openshift-network-diagnostics/network-check-target-ffbbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:15.070994 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.070732 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2 podName:94dc0cbf-ca85-4907-b94a-c68cb2b7e69e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:15.570713409 +0000 UTC m=+3.049926169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqt2" (UniqueName: "kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2") pod "network-check-target-ffbbz" (UID: "94dc0cbf-ca85-4907-b94a-c68cb2b7e69e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:15.071971 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.071946 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4jgq\" (UniqueName: \"kubernetes.io/projected/7f07ae0a-5a5c-4998-8b55-4c58e4a32223-kube-api-access-r4jgq\") pod \"node-ca-vvr6x\" (UID: \"7f07ae0a-5a5c-4998-8b55-4c58e4a32223\") " pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:15.072219 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.072194 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6d9s\" (UniqueName: \"kubernetes.io/projected/afab4908-5205-4800-8d18-32ba6c9c1241-kube-api-access-s6d9s\") pod \"iptables-alerter-8d6ff\" (UID: \"afab4908-5205-4800-8d18-32ba6c9c1241\") " pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:15.072658 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.072636 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hctz6\" (UniqueName: \"kubernetes.io/projected/ba1b075e-22f0-4617-a454-240bc9d78be8-kube-api-access-hctz6\") pod \"tuned-gk9sr\" (UID: \"ba1b075e-22f0-4617-a454-240bc9d78be8\") " pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.075468 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.075439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gxxz\" (UniqueName: \"kubernetes.io/projected/6b0a7a84-add5-486e-9927-acd6c716246c-kube-api-access-2gxxz\") pod \"ovnkube-node-5v4sd\" (UID: \"6b0a7a84-add5-486e-9927-acd6c716246c\") " pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.146765 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.146732 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" Jul 02 23:11:15.156020 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.155994 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6442c" Jul 02 23:11:15.165847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.165813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qvk4m" Jul 02 23:11:15.175637 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.175616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" Jul 02 23:11:15.185139 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.185115 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8d6ff" Jul 02 23:11:15.192837 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.192820 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:15.202458 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.202433 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:15.209801 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.209783 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" Jul 02 23:11:15.217255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.217240 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vvr6x" Jul 02 23:11:15.465052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.464965 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:15.465214 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.465080 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:15.465214 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.465136 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs podName:49f96f1f-ac38-4d3e-b171-00c95352ec56 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:16.465120416 +0000 UTC m=+3.944333156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs") pod "network-metrics-daemon-zpnlm" (UID: "49f96f1f-ac38-4d3e-b171-00c95352ec56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:15.566085 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.566050 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:15.566269 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.566182 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:15.566269 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.566240 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret podName:7a38af0d-67d8-4b5f-bdaf-338dd91be602 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:16.566226939 +0000 UTC m=+4.045439681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret") pod "global-pull-secret-syncer-wvx8s" (UID: "7a38af0d-67d8-4b5f-bdaf-338dd91be602") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:15.667177 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.667135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:15.667369 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.667319 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:11:15.667369 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.667347 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:11:15.667369 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.667361 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xgqt2 for pod openshift-network-diagnostics/network-check-target-ffbbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:15.667520 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:15.667425 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2 podName:94dc0cbf-ca85-4907-b94a-c68cb2b7e69e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:16.667406166 +0000 UTC m=+4.146618929 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqt2" (UniqueName: "kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2") pod "network-check-target-ffbbz" (UID: "94dc0cbf-ca85-4907-b94a-c68cb2b7e69e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:15.897011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.896921 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:06:14 +0000 UTC" deadline="2028-01-28 08:09:10.433394102 +0000 UTC" Jul 02 23:11:15.897011 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:15.896961 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13784h57m54.536437877s" Jul 02 23:11:16.009014 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:16.008981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:16.009014 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:16.009001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:16.009233 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.009120 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:16.009295 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.009240 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:16.155596 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.155570 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a2477b_4712_49f9_995d_4bf0d7f98213.slice/crio-03b4a1eb9014b21e7417b22422cc6df9f11f160c105dc0f55fd948361c8e0ee8 WatchSource:0}: Error finding container 03b4a1eb9014b21e7417b22422cc6df9f11f160c105dc0f55fd948361c8e0ee8: Status 404 returned error can't find the container with id 03b4a1eb9014b21e7417b22422cc6df9f11f160c105dc0f55fd948361c8e0ee8 Jul 02 23:11:16.156902 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.156784 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafab4908_5205_4800_8d18_32ba6c9c1241.slice/crio-9cf47cbb97ea79c555595f887bd9f1a0e7f5da8dd5bbe6a83623c6325d025614 WatchSource:0}: Error finding container 9cf47cbb97ea79c555595f887bd9f1a0e7f5da8dd5bbe6a83623c6325d025614: Status 404 returned error can't find the container with id 9cf47cbb97ea79c555595f887bd9f1a0e7f5da8dd5bbe6a83623c6325d025614 Jul 02 23:11:16.158332 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.158288 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb215e73_0ebf_455c_8c7a_7e18ab49c45d.slice/crio-cf623c044e9bca62fcf3bf87d41c1a541e3aeb96a0dbc733b70f8cb833580bbb WatchSource:0}: Error finding container cf623c044e9bca62fcf3bf87d41c1a541e3aeb96a0dbc733b70f8cb833580bbb: Status 404 returned error can't find the container with id cf623c044e9bca62fcf3bf87d41c1a541e3aeb96a0dbc733b70f8cb833580bbb Jul 02 23:11:16.164029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.163503 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c000021_9827_44c9_bc41_7455ba95f79e.slice/crio-34897ba83eac1917f5a197914052635de1bdc014a54fafb0393169bf5e4abfdc WatchSource:0}: Error finding container 34897ba83eac1917f5a197914052635de1bdc014a54fafb0393169bf5e4abfdc: Status 404 returned error can't find the container with id 34897ba83eac1917f5a197914052635de1bdc014a54fafb0393169bf5e4abfdc Jul 02 23:11:16.164029 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.163688 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0a7a84_add5_486e_9927_acd6c716246c.slice/crio-e04b314e51d561c50aea224a2e8d2dbdb23e306002304d51df6e66421e8eb134 WatchSource:0}: Error finding container e04b314e51d561c50aea224a2e8d2dbdb23e306002304d51df6e66421e8eb134: Status 404 returned error can't find the container with id e04b314e51d561c50aea224a2e8d2dbdb23e306002304d51df6e66421e8eb134 Jul 02 23:11:16.164958 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.164922 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f07ae0a_5a5c_4998_8b55_4c58e4a32223.slice/crio-095abd7ac9ecbbfb508b1de1fc2557063b475a108714303365e3db428308a37c WatchSource:0}: Error finding container 095abd7ac9ecbbfb508b1de1fc2557063b475a108714303365e3db428308a37c: Status 404 returned error can't find the container with id 095abd7ac9ecbbfb508b1de1fc2557063b475a108714303365e3db428308a37c Jul 02 23:11:16.166412 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.166144 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ab398b_68ab_46c0_ac42_2b0ff3b98c3d.slice/crio-1c2f623d8b13e87daebe241c8e1f67e06fcae7ca3ab36ad691cb6f943212c270 WatchSource:0}: Error finding container 1c2f623d8b13e87daebe241c8e1f67e06fcae7ca3ab36ad691cb6f943212c270: Status 404 returned error can't find the container with id 1c2f623d8b13e87daebe241c8e1f67e06fcae7ca3ab36ad691cb6f943212c270 Jul 02 23:11:16.169473 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:11:16.169049 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1b075e_22f0_4617_a454_240bc9d78be8.slice/crio-f2701a8ed4783e76a2e3b6749b788c12567c2a811f1c5be0fce06ea7d4e42bf3 WatchSource:0}: Error finding container f2701a8ed4783e76a2e3b6749b788c12567c2a811f1c5be0fce06ea7d4e42bf3: Status 404 returned error can't find the container with id f2701a8ed4783e76a2e3b6749b788c12567c2a811f1c5be0fce06ea7d4e42bf3 Jul 02 23:11:16.482400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:16.482210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:16.482400 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.482359 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:16.482570 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.482456 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs podName:49f96f1f-ac38-4d3e-b171-00c95352ec56 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:18.482438463 +0000 UTC m=+5.961651206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs") pod "network-metrics-daemon-zpnlm" (UID: "49f96f1f-ac38-4d3e-b171-00c95352ec56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:16.583818 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:16.583270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:16.583818 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.583428 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:16.583818 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.583490 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret podName:7a38af0d-67d8-4b5f-bdaf-338dd91be602 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:18.583472951 +0000 UTC m=+6.062685698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret") pod "global-pull-secret-syncer-wvx8s" (UID: "7a38af0d-67d8-4b5f-bdaf-338dd91be602") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:16.684800 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:16.684227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:16.684800 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.684390 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:11:16.684800 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.684413 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:11:16.684800 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.684426 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xgqt2 for pod openshift-network-diagnostics/network-check-target-ffbbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:16.684800 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:16.684482 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2 podName:94dc0cbf-ca85-4907-b94a-c68cb2b7e69e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:18.684463518 +0000 UTC m=+6.163676273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqt2" (UniqueName: "kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2") pod "network-check-target-ffbbz" (UID: "94dc0cbf-ca85-4907-b94a-c68cb2b7e69e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:16.898107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:16.898035 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:06:14 +0000 UTC" deadline="2028-03-20 01:45:00.214581318 +0000 UTC" Jul 02 23:11:16.898107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:16.898099 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15026h33m43.316486248s" Jul 02 23:11:17.012341 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.012265 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:17.012492 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:17.012398 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:17.033260 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.032617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" event={"ID":"18bcd73158ca1a5b1c82fc4d26d8e309","Type":"ContainerStarted","Data":"f79d7a5781b4dd246604b061fb02afdadd6eb8dc9568bc7714c42c3fb9d0ceca"} Jul 02 23:11:17.047556 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.047526 2578 generic.go:356] "Generic (PLEG): container finished" podID="505b89dd4f29cd1d6366a8221bca889f" containerID="37af6e29486c538f928f958a839e78d2b3e0b5c8da92ca4786aabc6e5621dc52" exitCode=0 Jul 02 23:11:17.047710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.047606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" event={"ID":"505b89dd4f29cd1d6366a8221bca889f","Type":"ContainerDied","Data":"37af6e29486c538f928f958a839e78d2b3e0b5c8da92ca4786aabc6e5621dc52"} Jul 02 23:11:17.055128 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.055091 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvr6x" event={"ID":"7f07ae0a-5a5c-4998-8b55-4c58e4a32223","Type":"ContainerStarted","Data":"095abd7ac9ecbbfb508b1de1fc2557063b475a108714303365e3db428308a37c"} Jul 02 23:11:17.068551 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.068501 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-236.ec2.internal" podStartSLOduration=3.068482306 podStartE2EDuration="3.068482306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:17.049620514 +0000 UTC m=+4.528833282" watchObservedRunningTime="2026-07-02 23:11:17.068482306 +0000 UTC m=+4.547695069" Jul 02 23:11:17.070421 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.070395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6442c" event={"ID":"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d","Type":"ContainerStarted","Data":"1c2f623d8b13e87daebe241c8e1f67e06fcae7ca3ab36ad691cb6f943212c270"} Jul 02 23:11:17.075029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.074953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"e04b314e51d561c50aea224a2e8d2dbdb23e306002304d51df6e66421e8eb134"} Jul 02 23:11:17.093833 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.093767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5ps4z" event={"ID":"2c000021-9827-44c9-bc41-7455ba95f79e","Type":"ContainerStarted","Data":"34897ba83eac1917f5a197914052635de1bdc014a54fafb0393169bf5e4abfdc"} Jul 02 23:11:17.102401 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.102350 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerStarted","Data":"4105cfdda7e0b3a704ed3413eb245e4315facf34654ebf7f2f0d42b84370586c"} Jul 02 23:11:17.115864 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.115802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvk4m" event={"ID":"cb215e73-0ebf-455c-8c7a-7e18ab49c45d","Type":"ContainerStarted","Data":"cf623c044e9bca62fcf3bf87d41c1a541e3aeb96a0dbc733b70f8cb833580bbb"} Jul 02 23:11:17.133490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.133461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" event={"ID":"ba1b075e-22f0-4617-a454-240bc9d78be8","Type":"ContainerStarted","Data":"f2701a8ed4783e76a2e3b6749b788c12567c2a811f1c5be0fce06ea7d4e42bf3"} Jul 02 23:11:17.147148 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.147018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8d6ff" event={"ID":"afab4908-5205-4800-8d18-32ba6c9c1241","Type":"ContainerStarted","Data":"9cf47cbb97ea79c555595f887bd9f1a0e7f5da8dd5bbe6a83623c6325d025614"} Jul 02 23:11:17.164360 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:17.164329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" event={"ID":"e4a2477b-4712-49f9-995d-4bf0d7f98213","Type":"ContainerStarted","Data":"03b4a1eb9014b21e7417b22422cc6df9f11f160c105dc0f55fd948361c8e0ee8"} Jul 02 23:11:18.009796 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:18.009759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:18.010272 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.009907 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:18.010333 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:18.010299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:18.010435 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.010413 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:18.176003 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:18.175965 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" event={"ID":"505b89dd4f29cd1d6366a8221bca889f","Type":"ContainerStarted","Data":"cb77a613d5c0f40d01bccdf94bbbb168fcdf9e39849d4d6303c689638843a2f4"} Jul 02 23:11:18.196743 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:18.196685 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-236.ec2.internal" podStartSLOduration=4.196663285 podStartE2EDuration="4.196663285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:18.196229929 +0000 UTC m=+5.675442692" watchObservedRunningTime="2026-07-02 23:11:18.196663285 +0000 UTC m=+5.675876047" Jul 02 23:11:18.498437 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:18.498342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:18.498660 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.498546 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:18.498660 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.498621 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs podName:49f96f1f-ac38-4d3e-b171-00c95352ec56 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:22.498602886 +0000 UTC m=+9.977815629 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs") pod "network-metrics-daemon-zpnlm" (UID: "49f96f1f-ac38-4d3e-b171-00c95352ec56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:18.599007 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:18.598970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:18.599186 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.599137 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:18.599246 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.599216 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret podName:7a38af0d-67d8-4b5f-bdaf-338dd91be602 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:22.599195625 +0000 UTC m=+10.078408376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret") pod "global-pull-secret-syncer-wvx8s" (UID: "7a38af0d-67d8-4b5f-bdaf-338dd91be602") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:18.699965 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:18.699863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:18.700177 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.700064 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:11:18.700177 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.700085 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:11:18.700177 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.700099 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xgqt2 for pod openshift-network-diagnostics/network-check-target-ffbbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:18.700177 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:18.700156 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2 podName:94dc0cbf-ca85-4907-b94a-c68cb2b7e69e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:22.700138306 +0000 UTC m=+10.179351065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqt2" (UniqueName: "kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2") pod "network-check-target-ffbbz" (UID: "94dc0cbf-ca85-4907-b94a-c68cb2b7e69e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:19.011804 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:19.011770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:19.012272 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:19.011919 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:20.010005 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:20.009968 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:20.010173 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:20.010097 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:20.010505 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:20.010487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:20.010614 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:20.010595 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:21.010872 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:21.010842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:21.011337 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:21.010977 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:22.009337 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:22.009298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:22.009516 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.009450 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:22.009799 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:22.009776 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:22.009907 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.009864 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:22.534540 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:22.534506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:22.534935 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.534645 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:22.534935 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.534713 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs podName:49f96f1f-ac38-4d3e-b171-00c95352ec56 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:30.534694734 +0000 UTC m=+18.013907475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs") pod "network-metrics-daemon-zpnlm" (UID: "49f96f1f-ac38-4d3e-b171-00c95352ec56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:22.635409 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:22.634970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:22.635409 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.635107 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:22.635409 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.635160 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret podName:7a38af0d-67d8-4b5f-bdaf-338dd91be602 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:30.635147284 +0000 UTC m=+18.114360023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret") pod "global-pull-secret-syncer-wvx8s" (UID: "7a38af0d-67d8-4b5f-bdaf-338dd91be602") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:22.735736 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:22.735700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:22.735928 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.735895 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:11:22.735928 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.735916 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:11:22.736047 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.735931 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xgqt2 for pod openshift-network-diagnostics/network-check-target-ffbbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:22.736047 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:22.735992 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2 podName:94dc0cbf-ca85-4907-b94a-c68cb2b7e69e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:30.735972723 +0000 UTC m=+18.215185467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqt2" (UniqueName: "kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2") pod "network-check-target-ffbbz" (UID: "94dc0cbf-ca85-4907-b94a-c68cb2b7e69e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:23.013319 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:23.013282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:23.013473 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:23.013415 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:24.009793 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:24.009755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:24.010193 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:24.009903 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:24.010193 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:24.009926 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:24.010193 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:24.010064 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:25.011494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:25.011459 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:25.011922 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:25.011592 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:26.009515 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:26.009480 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:26.009742 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:26.009527 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:26.009742 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:26.009645 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:26.009858 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:26.009743 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:27.009623 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:27.009590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:27.010028 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:27.009702 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:28.009716 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:28.009678 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:28.010179 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:28.009817 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:28.010179 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:28.009873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:28.010179 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:28.010000 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:29.009783 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:29.009748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:29.010282 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:29.009899 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:30.009368 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:30.009330 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:30.009647 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:30.009377 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:30.009647 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.009484 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:30.009647 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.009584 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:30.600012 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:30.599978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:30.600374 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.600150 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:30.600374 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.600212 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs podName:49f96f1f-ac38-4d3e-b171-00c95352ec56 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:46.60019646 +0000 UTC m=+34.079409199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs") pod "network-metrics-daemon-zpnlm" (UID: "49f96f1f-ac38-4d3e-b171-00c95352ec56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:30.700478 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:30.700448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:30.700623 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.700610 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:30.700682 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.700672 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret podName:7a38af0d-67d8-4b5f-bdaf-338dd91be602 nodeName:}" failed. No retries permitted until 2026-07-02 23:11:46.70065747 +0000 UTC m=+34.179870210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret") pod "global-pull-secret-syncer-wvx8s" (UID: "7a38af0d-67d8-4b5f-bdaf-338dd91be602") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:30.801752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:30.801714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:30.801975 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.801949 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:11:30.802086 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.801984 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:11:30.802086 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.801998 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xgqt2 for pod openshift-network-diagnostics/network-check-target-ffbbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:30.802086 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:30.802060 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2 podName:94dc0cbf-ca85-4907-b94a-c68cb2b7e69e nodeName:}" failed. No retries permitted until 2026-07-02 23:11:46.802039836 +0000 UTC m=+34.281252598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqt2" (UniqueName: "kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2") pod "network-check-target-ffbbz" (UID: "94dc0cbf-ca85-4907-b94a-c68cb2b7e69e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:31.009866 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:31.009827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:31.010073 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:31.009988 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:32.010024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:32.009982 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:32.010485 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:32.010032 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:32.010485 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:32.010114 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:32.010485 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:32.010234 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:33.009735 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:33.009707 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:33.009945 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:33.009798 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:34.009385 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:34.009346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:34.009821 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:34.009500 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:34.009911 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:34.009896 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:34.010008 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:34.009982 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:35.009947 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.009779 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:35.010446 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:35.010380 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:35.213124 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.212842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" event={"ID":"e4a2477b-4712-49f9-995d-4bf0d7f98213","Type":"ContainerStarted","Data":"6ef14a8e40b026a950574ec454966b8bde7b18f8d7fca941507a299034f8b999"} Jul 02 23:11:35.214277 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.214212 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vvr6x" event={"ID":"7f07ae0a-5a5c-4998-8b55-4c58e4a32223","Type":"ContainerStarted","Data":"83fd1a56e9a50bc5b852a56e24d48fc5d051ffdb7420e77fa4e49da1b38ec155"} Jul 02 23:11:35.215847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.215823 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6442c" event={"ID":"a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d","Type":"ContainerStarted","Data":"b9165dd7f0872c4ade73d4de37f2533a3b1fd01f1a1619bfd6f8564ac144123d"} Jul 02 23:11:35.217833 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.217796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"70f346d5552ca75193e512f6f4a84151f3e325cbc339279e7c1c63304ccccb52"} Jul 02 23:11:35.219149 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.219126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5ps4z" event={"ID":"2c000021-9827-44c9-bc41-7455ba95f79e","Type":"ContainerStarted","Data":"d85c64b23c1f4c8a1ff617a4d2380cb7f7274086c8c96741bdf6a8be7e061237"} Jul 02 23:11:35.220439 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.220415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerStarted","Data":"86a282e7e5fdf7148a2123de716fd6d40b98a8df60ecd58d5b648af9cda40687"} Jul 02 23:11:35.222032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.222004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qvk4m" event={"ID":"cb215e73-0ebf-455c-8c7a-7e18ab49c45d","Type":"ContainerStarted","Data":"810c7e8ccf479e280aa66beb4d61b58cea655175e3f1c2c53cdc039f241561b9"} Jul 02 23:11:35.223399 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.223380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" event={"ID":"ba1b075e-22f0-4617-a454-240bc9d78be8","Type":"ContainerStarted","Data":"6a2d026aa0371c211263e2cd7524404d4d0d3a30538dc02c7131135f02079c85"} Jul 02 23:11:35.229928 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.229872 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vvr6x" podStartSLOduration=3.474838558 podStartE2EDuration="22.229861245s" totalImagesPullingTime="18.755022687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:35.229614526 +0000 UTC m=+22.708827289" watchObservedRunningTime="2026-07-02 23:11:35.229861245 +0000 UTC m=+22.709074007" Jul 02 23:11:35.263631 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.263590 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5ps4z" podStartSLOduration=3.507507616 podStartE2EDuration="22.263574087s" totalImagesPullingTime="18.756066471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:35.245946652 +0000 UTC m=+22.725159414" watchObservedRunningTime="2026-07-02 23:11:35.263574087 +0000 UTC m=+22.742786848" Jul 02 23:11:35.285035 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.284902 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gk9sr" podStartSLOduration=3.508128791 podStartE2EDuration="22.284866963s" totalImagesPullingTime="18.776738172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:35.263388121 +0000 UTC m=+22.742600883" watchObservedRunningTime="2026-07-02 23:11:35.284866963 +0000 UTC m=+22.764079724" Jul 02 23:11:35.285135 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.285117 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6442c" podStartSLOduration=3.448815211 podStartE2EDuration="22.285110302s" totalImagesPullingTime="18.836295091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:35.284394209 +0000 UTC m=+22.763606971" watchObservedRunningTime="2026-07-02 23:11:35.285110302 +0000 UTC m=+22.764323063" Jul 02 23:11:35.336578 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.336431 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qvk4m" podStartSLOduration=3.566398864 podStartE2EDuration="22.336408754s" totalImagesPullingTime="18.77000989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:35.306840634 +0000 UTC m=+22.786053395" watchObservedRunningTime="2026-07-02 23:11:35.336408754 +0000 UTC m=+22.815621525" Jul 02 23:11:35.348963 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.348004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:35.428731 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.428655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:35.528529 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:35.528504 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:36.009527 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.009489 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:36.009750 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.009497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:36.009750 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:36.009634 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:36.009750 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:36.009715 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:36.228107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.228034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"ca1c3212614c1b2f0cd06e83d0bcd99a05a8ae113bab82e9946efde7293496b5"} Jul 02 23:11:36.228107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.228106 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"0423b7f57778723d79c8fa910f0b0c8ed834e962d6e552935d2a4f425486a7e1"} Jul 02 23:11:36.228924 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.228141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"b8403c3e13715ad37bb5941c86903ab4de0b7acd6909e3df6b874c93da590b3b"} Jul 02 23:11:36.228924 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.228178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"074a2415795b5f38882b02519e0772c5e0da8950b9b306e16998806595271c92"} Jul 02 23:11:36.228924 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.228214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"c5be3d3cfe1d2515d35be55f7c2abf8521571c0e2fe63725d57627d19e3077d4"} Jul 02 23:11:36.229376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.229356 2578 generic.go:356] "Generic (PLEG): container finished" podID="17aaa165-6fc7-48c2-9e48-4886fe694b80" containerID="86a282e7e5fdf7148a2123de716fd6d40b98a8df60ecd58d5b648af9cda40687" exitCode=0 Jul 02 23:11:36.229508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.229484 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerDied","Data":"86a282e7e5fdf7148a2123de716fd6d40b98a8df60ecd58d5b648af9cda40687"} Jul 02 23:11:36.525116 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.525096 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 23:11:36.921705 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.921576 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:11:36.525111925Z","UUID":"a10acd3d-f59d-4042-a406-2f90b53d47c8","Handler":null,"Name":"","Endpoint":""} Jul 02 23:11:36.923163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.923141 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 23:11:36.923299 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:36.923185 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 23:11:37.009687 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.009657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:37.009845 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:37.009761 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:37.233670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.233589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8d6ff" event={"ID":"afab4908-5205-4800-8d18-32ba6c9c1241","Type":"ContainerStarted","Data":"859c28bc100874075eac8ef4c52cefb96776852dafe96d5fddef3699eb683cf9"} Jul 02 23:11:37.235537 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.235494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" event={"ID":"e4a2477b-4712-49f9-995d-4bf0d7f98213","Type":"ContainerStarted","Data":"fd8efa676f94daf9a008fbe65c72f171bb9b939bb3c2e6d8abbb77d4f86ee2e7"} Jul 02 23:11:37.269280 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.269217 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8d6ff" podStartSLOduration=5.489463671 podStartE2EDuration="24.269197257s" totalImagesPullingTime="18.779733586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:37.261638727 +0000 UTC m=+24.740851488" watchObservedRunningTime="2026-07-02 23:11:37.269197257 +0000 UTC m=+24.748410019" Jul 02 23:11:37.430072 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.430036 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:37.528156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.528067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:37.748092 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.748061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:37.850173 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:37.850139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:38.009463 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.009440 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:38.009586 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:38.009550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:38.009647 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.009606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:38.009800 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:38.009777 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:38.201007 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.200975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:38.240858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.240823 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" event={"ID":"e4a2477b-4712-49f9-995d-4bf0d7f98213","Type":"ContainerStarted","Data":"0608798e68f3ff2a8b4a427a2aca101f522d5cb06594645b6708d88af9a24d49"} Jul 02 23:11:38.245159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.245132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"526053c2a8124cd28b20fc79d628b68750ecb066b65e9fd742404e9547ded084"} Jul 02 23:11:38.310833 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.310765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:38.410066 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.410031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:38.521547 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.521471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:38.590196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.590109 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:38.601338 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.601312 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:38.602027 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.602005 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:38.621012 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.620962 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7g6qt" podStartSLOduration=4.164792192 podStartE2EDuration="25.620944431s" totalImagesPullingTime="21.456152239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:38.267104882 +0000 UTC m=+25.746317645" watchObservedRunningTime="2026-07-02 23:11:38.620944431 +0000 UTC m=+26.100157194" Jul 02 23:11:38.766309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.766275 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:38.767343 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.767324 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5ps4z" Jul 02 23:11:38.785624 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.785593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:38.906779 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:38.906694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:39.009413 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:39.009383 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:39.009636 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:39.009518 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:39.062398 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:39.062364 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:39.169592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:39.169504 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:39.261822 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:39.261791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:40.010040 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:40.009812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:40.010200 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:40.009850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:40.010200 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:40.010155 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:40.010279 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:40.010229 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:40.074585 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:40.074561 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qvk4m_cb215e73-0ebf-455c-8c7a-7e18ab49c45d/dns-node-resolver/0.log" Jul 02 23:11:40.647344 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:40.647305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:40.714514 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:40.714484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:41.008992 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.008969 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:41.009085 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:41.009070 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:41.258012 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.257979 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" event={"ID":"6b0a7a84-add5-486e-9927-acd6c716246c","Type":"ContainerStarted","Data":"afd44f424c09643fe9d4b8cb2ae192a3054d3e160595d5ef6518ef5cb437bc00"} Jul 02 23:11:41.258370 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.258342 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:41.258476 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.258427 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:41.275111 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.274915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:41.275662 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.275643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvr6x_7f07ae0a-5a5c-4998-8b55-4c58e4a32223/node-ca/0.log" Jul 02 23:11:41.291483 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.291446 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" podStartSLOduration=9.443767086 podStartE2EDuration="28.291432874s" totalImagesPullingTime="18.847665788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:41.291145481 +0000 UTC m=+28.770358239" watchObservedRunningTime="2026-07-02 23:11:41.291432874 +0000 UTC m=+28.770645628" Jul 02 23:11:41.527814 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:41.527725 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:42.009947 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:42.009919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:42.009947 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:42.009953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:42.010707 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:42.010037 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:42.010707 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:42.010095 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:42.262290 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:42.262213 2578 generic.go:356] "Generic (PLEG): container finished" podID="17aaa165-6fc7-48c2-9e48-4886fe694b80" containerID="c3dc3d10d97e4bb983d1323038e1ea9e0d474c56d5ab01764e0b93a9fdbc5699" exitCode=0 Jul 02 23:11:42.262464 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:42.262308 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerDied","Data":"c3dc3d10d97e4bb983d1323038e1ea9e0d474c56d5ab01764e0b93a9fdbc5699"} Jul 02 23:11:42.262713 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:42.262696 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:42.278689 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:42.278665 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:11:43.009981 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:43.009953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:43.010344 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:43.010048 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:43.738899 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:43.738857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:44.009789 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:44.009704 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:44.009789 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:44.009741 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:44.010027 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:44.009814 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:44.010027 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:44.009866 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:44.230819 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:44.230787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:44.268435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:44.268364 2578 generic.go:356] "Generic (PLEG): container finished" podID="17aaa165-6fc7-48c2-9e48-4886fe694b80" containerID="3b7718d4732a3210cfdecefef3b9269931d7153ea0cad082879d1a49dfa96153" exitCode=0 Jul 02 23:11:44.268578 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:44.268428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerDied","Data":"3b7718d4732a3210cfdecefef3b9269931d7153ea0cad082879d1a49dfa96153"} Jul 02 23:11:44.855176 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:44.855138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:44.968986 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:44.968952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:45.009129 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:45.009093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:45.009320 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:45.009234 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:45.082168 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:45.082121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:45.192938 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:45.192910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:45.292805 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:45.292775 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:45.531913 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:45.531870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:46.009545 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.009510 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:46.009750 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.009553 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:46.009750 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.009623 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:46.009750 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.009729 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:46.274653 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.274570 2578 generic.go:356] "Generic (PLEG): container finished" podID="17aaa165-6fc7-48c2-9e48-4886fe694b80" containerID="203495d9b583c090caeacffb3b8decd1e917828ff5c42c9c4bdb9054f981f5b3" exitCode=0 Jul 02 23:11:46.274653 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.274606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerDied","Data":"203495d9b583c090caeacffb3b8decd1e917828ff5c42c9c4bdb9054f981f5b3"} Jul 02 23:11:46.518085 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.518053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:46.622382 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.622299 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:46.622527 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.622404 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:46.622527 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.622455 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs podName:49f96f1f-ac38-4d3e-b171-00c95352ec56 nodeName:}" failed. No retries permitted until 2026-07-02 23:12:18.622440035 +0000 UTC m=+66.101652775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs") pod "network-metrics-daemon-zpnlm" (UID: "49f96f1f-ac38-4d3e-b171-00c95352ec56") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 23:11:46.718063 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.718030 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:46.723250 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.723218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:46.723413 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.723389 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:46.723506 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.723494 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret podName:7a38af0d-67d8-4b5f-bdaf-338dd91be602 nodeName:}" failed. No retries permitted until 2026-07-02 23:12:18.72344893 +0000 UTC m=+66.202661685 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret") pod "global-pull-secret-syncer-wvx8s" (UID: "7a38af0d-67d8-4b5f-bdaf-338dd91be602") : object "kube-system"/"original-pull-secret" not registered Jul 02 23:11:46.818404 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.818363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:46.823633 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.823609 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:46.823780 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.823727 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 23:11:46.823780 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.823749 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 23:11:46.823780 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.823761 2578 projected.go:196] Error preparing data for projected volume kube-api-access-xgqt2 for pod openshift-network-diagnostics/network-check-target-ffbbz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:46.823968 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:46.823806 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2 podName:94dc0cbf-ca85-4907-b94a-c68cb2b7e69e nodeName:}" failed. No retries permitted until 2026-07-02 23:12:18.823793183 +0000 UTC m=+66.303005923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xgqt2" (UniqueName: "kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2") pod "network-check-target-ffbbz" (UID: "94dc0cbf-ca85-4907-b94a-c68cb2b7e69e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 23:11:46.918348 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:46.918273 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:47.009036 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:47.009006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:47.009211 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:47.009134 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:47.121856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:47.121827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:47.331843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:47.331811 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:47.721610 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:47.721568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:48.009848 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:48.009770 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:48.010039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:48.009769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:48.010039 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:48.009971 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:48.010158 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:48.010118 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:48.481109 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:48.481057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:48.566088 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:48.566045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:48.715769 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:48.715739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:48.926122 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:48.926091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:49.009642 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:49.009609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:49.009814 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:49.009735 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:49.122477 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:49.122442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:49.187474 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:49.187400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:50.009025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.008984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:50.009480 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:50.009102 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:50.009480 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.009162 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:50.009480 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:50.009283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:50.333684 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.333654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:50.526999 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.526969 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:50.623302 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.623233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:50.723229 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.723195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:50.823548 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.823519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:50.924655 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:50.924627 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:51.009891 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:51.009865 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:51.010277 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:51.009966 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:51.053727 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:51.053701 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:51.153896 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:51.153846 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:51.288233 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:51.288164 2578 generic.go:356] "Generic (PLEG): container finished" podID="17aaa165-6fc7-48c2-9e48-4886fe694b80" containerID="f850e41137e75fa4977916f60f3ce4365bda49ad2d9a17b19b85c1826cb68027" exitCode=0 Jul 02 23:11:51.288233 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:51.288205 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerDied","Data":"f850e41137e75fa4977916f60f3ce4365bda49ad2d9a17b19b85c1826cb68027"} Jul 02 23:11:52.009731 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.009695 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:52.009933 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:52.009801 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:52.009933 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.009860 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:52.010233 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:52.009987 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:52.190124 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.190091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:52.293358 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.293295 2578 generic.go:356] "Generic (PLEG): container finished" podID="17aaa165-6fc7-48c2-9e48-4886fe694b80" containerID="e66bf0935b9e635c3c7f420fd6ac8374bb37d645c61d2f5d8b3b76519d604474" exitCode=0 Jul 02 23:11:52.293358 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.293338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerDied","Data":"e66bf0935b9e635c3c7f420fd6ac8374bb37d645c61d2f5d8b3b76519d604474"} Jul 02 23:11:52.535689 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.535655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:52.722877 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.722845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:52.939344 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:52.939313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:53.010467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:53.010392 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:53.010806 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:53.010507 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:53.298161 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:53.298081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" event={"ID":"17aaa165-6fc7-48c2-9e48-4886fe694b80","Type":"ContainerStarted","Data":"f76c69bf13540ec9a5b47e3530c8162d221daae0d41a5311ebf4577a7a519fc5"} Jul 02 23:11:53.330489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:53.330436 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4mwlf" podStartSLOduration=10.314320543000001 podStartE2EDuration="40.330421329s" totalImagesPullingTime="30.016100786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:53.329921243 +0000 UTC m=+40.809134004" watchObservedRunningTime="2026-07-02 23:11:53.330421329 +0000 UTC m=+40.809634090" Jul 02 23:11:53.344340 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:53.344287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:53.448714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:53.448684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:53.927864 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:53.927832 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:54.009652 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:54.009620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:54.009823 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:54.009657 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:54.009823 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:54.009714 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:54.009918 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:54.009832 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:54.329137 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:54.329062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:54.718238 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:54.718208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:54.920438 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:54.920408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:55.009306 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:55.009223 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:55.009462 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:55.009360 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:55.340089 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:55.340003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:55.522671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:55.522640 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:11:56.008943 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:56.008914 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:56.009083 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:56.008948 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:56.009083 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:56.009018 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:56.009175 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:56.009127 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:57.009846 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:57.009804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:57.010267 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:57.009982 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:11:58.009041 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:58.009016 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:11:58.009203 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:58.009112 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:11:58.009203 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:58.009166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:11:58.009273 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:58.009258 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:11:59.009147 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:11:59.009112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:11:59.009589 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:11:59.009214 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:12:00.009449 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:00.009254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:00.009823 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:00.009254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:00.009823 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:00.009531 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:12:00.009823 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:00.009588 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:12:01.009760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:01.009727 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:01.010165 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:01.009836 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:12:01.791278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:01.791241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:01.876118 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:01.876087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:02.009282 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:02.009251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:02.009439 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:02.009291 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:02.009439 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:02.009382 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:12:02.009525 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:02.009500 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:12:02.176061 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:02.176032 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:02.276145 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:02.276111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:02.387794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:02.387758 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:02.498455 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:02.498378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:03.010547 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:03.010505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:03.010762 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:03.010627 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:12:03.275326 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:03.275239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zpnlm"] Jul 02 23:12:03.276008 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:03.275382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:03.276008 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:03.275490 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:12:03.278362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:03.278339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wvx8s"] Jul 02 23:12:03.279017 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:03.278997 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ffbbz"] Jul 02 23:12:03.279116 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:03.279092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:03.279207 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:03.279187 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:12:03.320725 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:03.320699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:03.320848 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:03.320803 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:12:05.009484 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:05.009454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:05.009484 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:05.009477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:05.010135 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:05.009461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:05.010135 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:05.009560 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zpnlm" podUID="49f96f1f-ac38-4d3e-b171-00c95352ec56" Jul 02 23:12:05.010135 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:05.009619 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wvx8s" podUID="7a38af0d-67d8-4b5f-bdaf-338dd91be602" Jul 02 23:12:05.010135 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:05.009675 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ffbbz" podUID="94dc0cbf-ca85-4907-b94a-c68cb2b7e69e" Jul 02 23:12:06.109975 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.109941 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:06.208731 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.208690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:06.286560 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.286527 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:06.544520 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.544351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:06.625846 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.625819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:06.684618 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.684586 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:06.835268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.835164 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-236.ec2.internal" event="NodeReady" Jul 02 23:12:06.835400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.835305 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 23:12:06.882714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.882503 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-858xz"] Jul 02 23:12:06.887076 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.887052 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nwg5j"] Jul 02 23:12:06.887209 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.887193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-858xz" Jul 02 23:12:06.889567 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.889548 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2clb5\"" Jul 02 23:12:06.889780 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.889762 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 23:12:06.889863 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.889768 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 23:12:06.893671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.893650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:06.895842 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.895693 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 23:12:06.895842 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.895725 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rpvf9\"" Jul 02 23:12:06.896029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.895856 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-858xz"] Jul 02 23:12:06.896029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.895897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 23:12:06.896029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.895858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 23:12:06.899093 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.899069 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nwg5j"] Jul 02 23:12:06.972791 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.972754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a905999-632d-4f54-9d61-1f709070a358-cert\") pod \"ingress-canary-nwg5j\" (UID: \"4a905999-632d-4f54-9d61-1f709070a358\") " pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:06.972791 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.972789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8364921-698b-472d-b26a-aa4b52faeb73-config-volume\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:06.973034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.972807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8364921-698b-472d-b26a-aa4b52faeb73-metrics-tls\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:06.973034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.972923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twvb5\" (UniqueName: \"kubernetes.io/projected/4a905999-632d-4f54-9d61-1f709070a358-kube-api-access-twvb5\") pod \"ingress-canary-nwg5j\" (UID: \"4a905999-632d-4f54-9d61-1f709070a358\") " pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:06.973034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.972969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8364921-698b-472d-b26a-aa4b52faeb73-tmp-dir\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:06.973034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.973022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zld7\" (UniqueName: \"kubernetes.io/projected/e8364921-698b-472d-b26a-aa4b52faeb73-kube-api-access-4zld7\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:06.996659 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:06.996635 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bf5n8"] Jul 02 23:12:07.010524 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.010496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.013709 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.013690 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:07.013811 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.013771 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:07.013933 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.013850 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:07.015721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.015704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 23:12:07.015837 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.015820 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w77h\"" Jul 02 23:12:07.016411 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.016349 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 23:12:07.018690 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.018666 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 23:12:07.018840 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.018782 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 23:12:07.018934 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.018911 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 23:12:07.019119 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.019090 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 23:12:07.019710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.019471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 23:12:07.019710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.019476 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qmzc5\"" Jul 02 23:12:07.019710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.019543 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 23:12:07.019710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.019559 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-872wr\"" Jul 02 23:12:07.020309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.020289 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bf5n8"] Jul 02 23:12:07.029364 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.029331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:07.073775 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.073748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8364921-698b-472d-b26a-aa4b52faeb73-tmp-dir\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.073898 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.073791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zld7\" (UniqueName: \"kubernetes.io/projected/e8364921-698b-472d-b26a-aa4b52faeb73-kube-api-access-4zld7\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.073898 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.073813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.073898 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.073851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jz9s\" (UniqueName: \"kubernetes.io/projected/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-kube-api-access-6jz9s\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.074013 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.073944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a905999-632d-4f54-9d61-1f709070a358-cert\") pod \"ingress-canary-nwg5j\" (UID: \"4a905999-632d-4f54-9d61-1f709070a358\") " pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:07.074013 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.073983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-crio-socket\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.074097 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.074013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-data-volume\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.074097 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.074045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8364921-698b-472d-b26a-aa4b52faeb73-config-volume\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.074199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.074090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8364921-698b-472d-b26a-aa4b52faeb73-metrics-tls\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.074199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.074127 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8364921-698b-472d-b26a-aa4b52faeb73-tmp-dir\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.074199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.074192 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.074342 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.074249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twvb5\" (UniqueName: \"kubernetes.io/projected/4a905999-632d-4f54-9d61-1f709070a358-kube-api-access-twvb5\") pod \"ingress-canary-nwg5j\" (UID: \"4a905999-632d-4f54-9d61-1f709070a358\") " pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:07.074568 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.074545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8364921-698b-472d-b26a-aa4b52faeb73-config-volume\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.077820 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.077800 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8364921-698b-472d-b26a-aa4b52faeb73-metrics-tls\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.078109 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.078089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a905999-632d-4f54-9d61-1f709070a358-cert\") pod \"ingress-canary-nwg5j\" (UID: \"4a905999-632d-4f54-9d61-1f709070a358\") " pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:07.082729 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.082700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zld7\" (UniqueName: \"kubernetes.io/projected/e8364921-698b-472d-b26a-aa4b52faeb73-kube-api-access-4zld7\") pod \"dns-default-858xz\" (UID: \"e8364921-698b-472d-b26a-aa4b52faeb73\") " pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.082977 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.082952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twvb5\" (UniqueName: \"kubernetes.io/projected/4a905999-632d-4f54-9d61-1f709070a358-kube-api-access-twvb5\") pod \"ingress-canary-nwg5j\" (UID: \"4a905999-632d-4f54-9d61-1f709070a358\") " pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:07.087721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.087675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:07.174872 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.174842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jz9s\" (UniqueName: \"kubernetes.io/projected/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-kube-api-access-6jz9s\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.175278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.174893 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-crio-socket\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.175278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.174916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-data-volume\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.175278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.175054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.175278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.175066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-crio-socket\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.175278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.175156 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.175278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.175241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-data-volume\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.175512 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.175495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.177378 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.177360 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.183105 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.183086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jz9s\" (UniqueName: \"kubernetes.io/projected/aa0dbb1b-ade4-49c3-af59-779c6e457dd4-kube-api-access-6jz9s\") pod \"insights-runtime-extractor-bf5n8\" (UID: \"aa0dbb1b-ade4-49c3-af59-779c6e457dd4\") " pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.197065 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.197044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-858xz" Jul 02 23:12:07.204139 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.204124 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nwg5j" Jul 02 23:12:07.326483 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.326382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bf5n8" Jul 02 23:12:07.364873 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.364843 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-858xz"] Jul 02 23:12:07.368334 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.368305 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nwg5j"] Jul 02 23:12:07.368730 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:07.368706 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8364921_698b_472d_b26a_aa4b52faeb73.slice/crio-d1a2fa07eb68d614e9ae589793471f3a4d139235bd1cac0d3e8f6d4eb822dfc2 WatchSource:0}: Error finding container d1a2fa07eb68d614e9ae589793471f3a4d139235bd1cac0d3e8f6d4eb822dfc2: Status 404 returned error can't find the container with id d1a2fa07eb68d614e9ae589793471f3a4d139235bd1cac0d3e8f6d4eb822dfc2 Jul 02 23:12:07.372035 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:07.372010 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a905999_632d_4f54_9d61_1f709070a358.slice/crio-7fcc8397ed6ae416e0da7a3ead3d2a86e1ac1eb301582a42559ebf369d3694bb WatchSource:0}: Error finding container 7fcc8397ed6ae416e0da7a3ead3d2a86e1ac1eb301582a42559ebf369d3694bb: Status 404 returned error can't find the container with id 7fcc8397ed6ae416e0da7a3ead3d2a86e1ac1eb301582a42559ebf369d3694bb Jul 02 23:12:07.466630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:07.466592 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bf5n8"] Jul 02 23:12:07.469919 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:07.469876 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0dbb1b_ade4_49c3_af59_779c6e457dd4.slice/crio-e7f638f2da3d872d1bef695002940e9a70f0d0552d6117e82a886da88d58eba0 WatchSource:0}: Error finding container e7f638f2da3d872d1bef695002940e9a70f0d0552d6117e82a886da88d58eba0: Status 404 returned error can't find the container with id e7f638f2da3d872d1bef695002940e9a70f0d0552d6117e82a886da88d58eba0 Jul 02 23:12:08.337915 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:08.337768 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf5n8" event={"ID":"aa0dbb1b-ade4-49c3-af59-779c6e457dd4","Type":"ContainerStarted","Data":"e7f638f2da3d872d1bef695002940e9a70f0d0552d6117e82a886da88d58eba0"} Jul 02 23:12:08.339564 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:08.339537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nwg5j" event={"ID":"4a905999-632d-4f54-9d61-1f709070a358","Type":"ContainerStarted","Data":"7fcc8397ed6ae416e0da7a3ead3d2a86e1ac1eb301582a42559ebf369d3694bb"} Jul 02 23:12:08.340665 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:08.340639 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-858xz" event={"ID":"e8364921-698b-472d-b26a-aa4b52faeb73","Type":"ContainerStarted","Data":"d1a2fa07eb68d614e9ae589793471f3a4d139235bd1cac0d3e8f6d4eb822dfc2"} Jul 02 23:12:08.987732 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:08.987695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:09.048902 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:09.048861 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:10.832296 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:10.832262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:10.892289 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:10.892253 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:10.946240 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:10.946210 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:12.313337 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.313306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:12.344356 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.344289 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl"] Jul 02 23:12:12.346421 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.346396 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.349858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.349564 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 23:12:12.349858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.349621 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 23:12:12.349858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.349628 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 23:12:12.349858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.349572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 23:12:12.349858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.349572 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 23:12:12.349858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.349844 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cq9gd\"" Jul 02 23:12:12.356931 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.356911 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl"] Jul 02 23:12:12.377906 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.377860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:12.416717 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.416597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ngg2\" (UniqueName: \"kubernetes.io/projected/3110f218-a042-4cb3-bf9f-553407becd7e-kube-api-access-8ngg2\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.416717 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.416646 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.416717 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.416663 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.416840 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.416720 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3110f218-a042-4cb3-bf9f-553407becd7e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.517059 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.517034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ngg2\" (UniqueName: \"kubernetes.io/projected/3110f218-a042-4cb3-bf9f-553407becd7e-kube-api-access-8ngg2\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.517171 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.517082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.517171 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.517100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.517171 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.517124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3110f218-a042-4cb3-bf9f-553407becd7e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.517438 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:12.517380 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 02 23:12:12.517506 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:12.517441 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-tls podName:3110f218-a042-4cb3-bf9f-553407becd7e nodeName:}" failed. No retries permitted until 2026-07-02 23:12:13.017421084 +0000 UTC m=+60.496633835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-7tqvl" (UID: "3110f218-a042-4cb3-bf9f-553407becd7e") : secret "prometheus-operator-tls" not found Jul 02 23:12:12.517903 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.517845 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3110f218-a042-4cb3-bf9f-553407becd7e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.521572 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.521545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.527156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.526901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ngg2\" (UniqueName: \"kubernetes.io/projected/3110f218-a042-4cb3-bf9f-553407becd7e-kube-api-access-8ngg2\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:12.666751 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:12.666713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:13.020020 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.019986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:13.022357 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.022322 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3110f218-a042-4cb3-bf9f-553407becd7e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7tqvl\" (UID: \"3110f218-a042-4cb3-bf9f-553407becd7e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:13.260745 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.260714 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cq9gd\"" Jul 02 23:12:13.268585 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.268566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" Jul 02 23:12:13.355275 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.355243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf5n8" event={"ID":"aa0dbb1b-ade4-49c3-af59-779c6e457dd4","Type":"ContainerStarted","Data":"1c062542ddf972b5ddb7488efcf9afe8df4181df2a392b96264219632965bab2"} Jul 02 23:12:13.355589 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.355312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf5n8" event={"ID":"aa0dbb1b-ade4-49c3-af59-779c6e457dd4","Type":"ContainerStarted","Data":"8a976e24a9da4c7cfc771cc7dd7a6714bf364c32c09fb1d23d437824ddbfaf62"} Jul 02 23:12:13.357441 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.357408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nwg5j" event={"ID":"4a905999-632d-4f54-9d61-1f709070a358","Type":"ContainerStarted","Data":"5edc49d8a9bda9407d54118825422336a120cba531036a3562aeb7a23b3a30c0"} Jul 02 23:12:13.359356 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.359332 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-858xz" event={"ID":"e8364921-698b-472d-b26a-aa4b52faeb73","Type":"ContainerStarted","Data":"24171494b9b8be99168179feeeede08ac511f1c84faebac73f79f1b5507a9b9f"} Jul 02 23:12:13.359478 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.359376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-858xz" event={"ID":"e8364921-698b-472d-b26a-aa4b52faeb73","Type":"ContainerStarted","Data":"e475caa6161fef51fbb80fcaa60b5d2e8cbc279d97a9cb4c8e35b811e0191b71"} Jul 02 23:12:13.359539 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.359479 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-858xz" Jul 02 23:12:13.373789 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.373747 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nwg5j" podStartSLOduration=2.3304137320000002 podStartE2EDuration="7.373732999s" totalImagesPullingTime="5.043319267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:13.373115285 +0000 UTC m=+60.852328052" watchObservedRunningTime="2026-07-02 23:12:13.373732999 +0000 UTC m=+60.852945739" Jul 02 23:12:13.393067 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.393004 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-858xz" podStartSLOduration=2.348277259 podStartE2EDuration="7.392984908s" totalImagesPullingTime="5.044707649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:13.392063621 +0000 UTC m=+60.871276384" watchObservedRunningTime="2026-07-02 23:12:13.392984908 +0000 UTC m=+60.872197671" Jul 02 23:12:13.412833 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:13.412797 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl"] Jul 02 23:12:13.418529 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:13.418502 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3110f218_a042_4cb3_bf9f_553407becd7e.slice/crio-9b9fa5139872c764d56f5555d769e8c2c52dc990b34fa977040fddbcc58f6847 WatchSource:0}: Error finding container 9b9fa5139872c764d56f5555d769e8c2c52dc990b34fa977040fddbcc58f6847: Status 404 returned error can't find the container with id 9b9fa5139872c764d56f5555d769e8c2c52dc990b34fa977040fddbcc58f6847 Jul 02 23:12:14.284730 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:14.284699 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5v4sd" Jul 02 23:12:14.364330 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:14.364280 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" event={"ID":"3110f218-a042-4cb3-bf9f-553407becd7e","Type":"ContainerStarted","Data":"9b9fa5139872c764d56f5555d769e8c2c52dc990b34fa977040fddbcc58f6847"} Jul 02 23:12:14.409638 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:14.409601 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:14.476337 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:14.476305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:16.164802 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.164717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:16.372079 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.372040 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bf5n8" event={"ID":"aa0dbb1b-ade4-49c3-af59-779c6e457dd4","Type":"ContainerStarted","Data":"d9cdd2d3635ba7926ae6b767870a9f6949ff77e62fdc9455f1e04594692fd522"} Jul 02 23:12:16.373662 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.373635 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" event={"ID":"3110f218-a042-4cb3-bf9f-553407becd7e","Type":"ContainerStarted","Data":"72ac12ab44037a605a720af4cd0d5394c6839dfa5713d0d800fc51f97d01d53d"} Jul 02 23:12:16.373775 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.373682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" event={"ID":"3110f218-a042-4cb3-bf9f-553407becd7e","Type":"ContainerStarted","Data":"c984670dfcc52d61a5710c9b218baed41c97cd71f448ae68aef614580fa245cd"} Jul 02 23:12:16.388975 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.388936 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bf5n8" podStartSLOduration=2.109464313 podStartE2EDuration="10.388922548s" totalImagesPullingTime="8.279458235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:12:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:16.38819939 +0000 UTC m=+63.867412149" watchObservedRunningTime="2026-07-02 23:12:16.388922548 +0000 UTC m=+63.868135310" Jul 02 23:12:16.404037 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.404001 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7tqvl" podStartSLOduration=1.946542583 podStartE2EDuration="4.403988729s" totalImagesPullingTime="2.457446146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:16.403663481 +0000 UTC m=+63.882876243" watchObservedRunningTime="2026-07-02 23:12:16.403988729 +0000 UTC m=+63.883201490" Jul 02 23:12:16.780115 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.780084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:16.837043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:16.837013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:18.452387 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.452341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:18.667756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.667717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:18.669966 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.669948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 23:12:18.673571 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.673550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:18.680684 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.680665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49f96f1f-ac38-4d3e-b171-00c95352ec56-metrics-certs\") pod \"network-metrics-daemon-zpnlm\" (UID: \"49f96f1f-ac38-4d3e-b171-00c95352ec56\") " pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:18.698131 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.698104 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh"] Jul 02 23:12:18.701132 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.701118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.703371 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.703307 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 23:12:18.703467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.703388 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 23:12:18.703665 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.703648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pj5db\"" Jul 02 23:12:18.712691 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.712667 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh"] Jul 02 23:12:18.730702 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.730676 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h"] Jul 02 23:12:18.733448 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.733432 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kwl68"] Jul 02 23:12:18.733572 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.733557 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.735995 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.735979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.738072 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738053 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 23:12:18.738162 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738055 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 23:12:18.738162 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m7956\"" Jul 02 23:12:18.738469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738450 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 23:12:18.738469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738450 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wq2d5\"" Jul 02 23:12:18.738625 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738492 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 23:12:18.738625 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738557 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 23:12:18.738625 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.738592 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 23:12:18.741091 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.741070 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-872wr\"" Jul 02 23:12:18.748627 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.748611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zpnlm" Jul 02 23:12:18.750268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.750251 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h"] Jul 02 23:12:18.768331 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.768307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.768474 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.768343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.768474 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.768370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.768474 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.768453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:18.768592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.768499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flf4w\" (UniqueName: \"kubernetes.io/projected/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-kube-api-access-flf4w\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.771862 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.771838 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 23:12:18.781452 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.781430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7a38af0d-67d8-4b5f-bdaf-338dd91be602-original-pull-secret\") pod \"global-pull-secret-syncer-wvx8s\" (UID: \"7a38af0d-67d8-4b5f-bdaf-338dd91be602\") " pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:18.789288 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.789262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:18.864308 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.864282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:18.869592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:18.869741 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869598 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flf4w\" (UniqueName: \"kubernetes.io/projected/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-kube-api-access-flf4w\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.869741 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ffjj\" (UniqueName: \"kubernetes.io/projected/1a938782-ad0d-4e31-9df9-39f888178f07-kube-api-access-9ffjj\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.869741 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.869741 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869667 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.869741 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869712 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/beab0178-556e-45d2-afe0-8251cf279440-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-tls\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a938782-ad0d-4e31-9df9-39f888178f07-metrics-client-ca\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869804 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8lj6\" (UniqueName: \"kubernetes.io/projected/beab0178-556e-45d2-afe0-8251cf279440-kube-api-access-l8lj6\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-root\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-wtmp\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.869945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-textfile\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.870025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.870007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.870293 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.870044 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beab0178-556e-45d2-afe0-8251cf279440-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.870293 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.870083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.870293 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.870104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.870293 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.870152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-sys\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.870293 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.870231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.870804 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.870745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.872022 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.872005 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 23:12:18.872377 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.872356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.872485 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.872469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.876064 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.876044 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zpnlm"] Jul 02 23:12:18.879488 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:18.879465 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f96f1f_ac38_4d3e_b171_00c95352ec56.slice/crio-f42d6374e298c73658329aa1a48cd9dc0c0bd221fb8ad709bdfe17d6486d1ac3 WatchSource:0}: Error finding container f42d6374e298c73658329aa1a48cd9dc0c0bd221fb8ad709bdfe17d6486d1ac3: Status 404 returned error can't find the container with id f42d6374e298c73658329aa1a48cd9dc0c0bd221fb8ad709bdfe17d6486d1ac3 Jul 02 23:12:18.879969 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.879951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flf4w\" (UniqueName: \"kubernetes.io/projected/15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa-kube-api-access-flf4w\") pod \"openshift-state-metrics-54cf96dfcf-kdbwh\" (UID: \"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:18.882075 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.882061 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 23:12:18.893444 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.893421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqt2\" (UniqueName: \"kubernetes.io/projected/94dc0cbf-ca85-4907-b94a-c68cb2b7e69e-kube-api-access-xgqt2\") pod \"network-check-target-ffbbz\" (UID: \"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e\") " pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:18.964830 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.964749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:18.970955 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.970932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beab0178-556e-45d2-afe0-8251cf279440-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.971030 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.970970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.971121 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-sys\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971195 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971172 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ffjj\" (UniqueName: \"kubernetes.io/projected/1a938782-ad0d-4e31-9df9-39f888178f07-kube-api-access-9ffjj\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971248 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971295 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971245 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-sys\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971368 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971410 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/beab0178-556e-45d2-afe0-8251cf279440-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.971462 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-tls\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971637 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a938782-ad0d-4e31-9df9-39f888178f07-metrics-client-ca\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.971756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971687 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8lj6\" (UniqueName: \"kubernetes.io/projected/beab0178-556e-45d2-afe0-8251cf279440-kube-api-access-l8lj6\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.971756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971695 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.971756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-root\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-wtmp\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.971756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971739 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beab0178-556e-45d2-afe0-8251cf279440-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-root\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:18.971801 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/beab0178-556e-45d2-afe0-8251cf279440-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:18.971862 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-tls podName:beab0178-556e-45d2-afe0-8251cf279440 nodeName:}" failed. No retries permitted until 2026-07-02 23:12:19.471843502 +0000 UTC m=+66.951056246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-jz85h" (UID: "beab0178-556e-45d2-afe0-8251cf279440") : secret "kube-state-metrics-tls" not found Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-textfile\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971937 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-wtmp\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.971945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.972077 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.972043 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.972434 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.972148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a938782-ad0d-4e31-9df9-39f888178f07-metrics-client-ca\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.972434 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.972174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-textfile\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.973934 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.973913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-tls\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.974181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.974159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a938782-ad0d-4e31-9df9-39f888178f07-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:18.974255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.974240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.979644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.979619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8lj6\" (UniqueName: \"kubernetes.io/projected/beab0178-556e-45d2-afe0-8251cf279440-kube-api-access-l8lj6\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:18.979733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:18.979680 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ffjj\" (UniqueName: \"kubernetes.io/projected/1a938782-ad0d-4e31-9df9-39f888178f07-kube-api-access-9ffjj\") pod \"node-exporter-kwl68\" (UID: \"1a938782-ad0d-4e31-9df9-39f888178f07\") " pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:19.009810 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.009760 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" Jul 02 23:12:19.029781 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.029758 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qmzc5\"" Jul 02 23:12:19.033652 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.033626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wvx8s" Jul 02 23:12:19.038429 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.038410 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:19.048609 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.048570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwl68" Jul 02 23:12:19.065226 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:19.065191 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a938782_ad0d_4e31_9df9_39f888178f07.slice/crio-23075ecfc3da0adfbe0419089c9fe0959d1f5d67cd3b9bb0e41f7582358d0162 WatchSource:0}: Error finding container 23075ecfc3da0adfbe0419089c9fe0959d1f5d67cd3b9bb0e41f7582358d0162: Status 404 returned error can't find the container with id 23075ecfc3da0adfbe0419089c9fe0959d1f5d67cd3b9bb0e41f7582358d0162 Jul 02 23:12:19.067380 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.067170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:19.157583 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.157498 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh"] Jul 02 23:12:19.160997 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.160967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:19.161466 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:19.161440 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e0cfa7_cd5b_48ad_84f6_9bceb2c05baa.slice/crio-b4cb6de78d432da4f5e1cab27807dd58e5263ebeb85b7f402f90ed56614ea1ef WatchSource:0}: Error finding container b4cb6de78d432da4f5e1cab27807dd58e5263ebeb85b7f402f90ed56614ea1ef: Status 404 returned error can't find the container with id b4cb6de78d432da4f5e1cab27807dd58e5263ebeb85b7f402f90ed56614ea1ef Jul 02 23:12:19.184946 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.184915 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wvx8s"] Jul 02 23:12:19.194896 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:19.194852 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a38af0d_67d8_4b5f_bdaf_338dd91be602.slice/crio-0f0ba0ce6c5c6472abe2c5b2c2d016de7bbe8b40a755a70093b0e20206d30be2 WatchSource:0}: Error finding container 0f0ba0ce6c5c6472abe2c5b2c2d016de7bbe8b40a755a70093b0e20206d30be2: Status 404 returned error can't find the container with id 0f0ba0ce6c5c6472abe2c5b2c2d016de7bbe8b40a755a70093b0e20206d30be2 Jul 02 23:12:19.201457 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.201432 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ffbbz"] Jul 02 23:12:19.215768 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:19.215747 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94dc0cbf_ca85_4907_b94a_c68cb2b7e69e.slice/crio-06b21625df645a9f35f89ed55b066a798b4c6fa9a9cd5f412f9547fe2c6d1a6a WatchSource:0}: Error finding container 06b21625df645a9f35f89ed55b066a798b4c6fa9a9cd5f412f9547fe2c6d1a6a: Status 404 returned error can't find the container with id 06b21625df645a9f35f89ed55b066a798b4c6fa9a9cd5f412f9547fe2c6d1a6a Jul 02 23:12:19.386808 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.386762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ffbbz" event={"ID":"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e","Type":"ContainerStarted","Data":"06b21625df645a9f35f89ed55b066a798b4c6fa9a9cd5f412f9547fe2c6d1a6a"} Jul 02 23:12:19.388183 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.388157 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zpnlm" event={"ID":"49f96f1f-ac38-4d3e-b171-00c95352ec56","Type":"ContainerStarted","Data":"f42d6374e298c73658329aa1a48cd9dc0c0bd221fb8ad709bdfe17d6486d1ac3"} Jul 02 23:12:19.389542 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.389516 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwl68" event={"ID":"1a938782-ad0d-4e31-9df9-39f888178f07","Type":"ContainerStarted","Data":"23075ecfc3da0adfbe0419089c9fe0959d1f5d67cd3b9bb0e41f7582358d0162"} Jul 02 23:12:19.390775 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.390727 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wvx8s" event={"ID":"7a38af0d-67d8-4b5f-bdaf-338dd91be602","Type":"ContainerStarted","Data":"0f0ba0ce6c5c6472abe2c5b2c2d016de7bbe8b40a755a70093b0e20206d30be2"} Jul 02 23:12:19.392700 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.392676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" event={"ID":"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa","Type":"ContainerStarted","Data":"03ae545171833a7763cc36d5a7567e6b9eefd8c926a545861ffd28c38f71c0bc"} Jul 02 23:12:19.392792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.392722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" event={"ID":"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa","Type":"ContainerStarted","Data":"aa124bc662a0a3acd0edde8d222af47641f903875e6e1efecadb2bfc89b2061f"} Jul 02 23:12:19.392792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.392742 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" event={"ID":"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa","Type":"ContainerStarted","Data":"b4cb6de78d432da4f5e1cab27807dd58e5263ebeb85b7f402f90ed56614ea1ef"} Jul 02 23:12:19.474509 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.474417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:19.477211 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.477158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beab0178-556e-45d2-afe0-8251cf279440-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-jz85h\" (UID: \"beab0178-556e-45d2-afe0-8251cf279440\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:19.549899 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.549854 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:19.644917 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.644705 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" Jul 02 23:12:19.697196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.697141 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:19.790870 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.790785 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:19.797127 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.797098 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:12:19.801965 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.800790 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.805752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.803359 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 23:12:19.805752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.803839 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 23:12:19.805752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.804140 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 23:12:19.805752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.804471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 23:12:19.805752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.804722 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mpwhm\"" Jul 02 23:12:19.805752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.804965 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 23:12:19.805752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.805145 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 23:12:19.806772 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.805866 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 23:12:19.806772 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.805998 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 23:12:19.806772 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.806201 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 23:12:19.817733 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.817707 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:12:19.879015 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.878978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879164 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-config-out\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879164 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-web-config\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879164 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879164 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879164 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879321 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879321 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879321 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-config-volume\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879321 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl86d\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-kube-api-access-rl86d\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879432 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879432 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.879432 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.879362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.912455 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.912420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-config-volume\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl86d\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-kube-api-access-rl86d\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-config-out\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-web-config\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981764 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.982744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.981922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.984819 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.984130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.984819 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.984766 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.986181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.986137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.992289 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.992264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.992753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.992355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.992753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.992430 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.992753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.992663 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-web-config\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.993086 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.992957 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-tls-assets\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.993418 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.993357 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.993418 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.993407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-config-volume\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.993764 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.993745 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.994203 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.994173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-config-out\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:19.996112 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:19.996069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl86d\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-kube-api-access-rl86d\") pod \"alertmanager-main-0\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:20.115487 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.115391 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:12:20.705632 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.703820 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-574db4cbc9-q4frf"] Jul 02 23:12:20.713910 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.713867 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.718255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.718229 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5wfjf\"" Jul 02 23:12:20.718464 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.718445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 23:12:20.718717 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.718699 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 23:12:20.721422 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.721394 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 23:12:20.724319 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.721708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 23:12:20.724319 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.722609 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ej6ojdet5pr3c\"" Jul 02 23:12:20.724319 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.722806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 23:12:20.727776 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.727646 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-574db4cbc9-q4frf"] Jul 02 23:12:20.790671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.790529 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.790671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.790585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-grpc-tls\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.793936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.791150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.793936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.791283 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.793936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.791584 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.793936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.791777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-tls\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.793936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.791821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f569501-9196-45e4-b2d0-c50ddd4bd231-metrics-client-ca\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.793936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.791860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-287tx\" (UniqueName: \"kubernetes.io/projected/1f569501-9196-45e4-b2d0-c50ddd4bd231-kube-api-access-287tx\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.805189 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.805046 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:12:20.816646 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.816537 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h"] Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.892746 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f569501-9196-45e4-b2d0-c50ddd4bd231-metrics-client-ca\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.892801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-287tx\" (UniqueName: \"kubernetes.io/projected/1f569501-9196-45e4-b2d0-c50ddd4bd231-kube-api-access-287tx\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.892864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.892917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-grpc-tls\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.892948 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.892995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.893029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.893500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.893067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-tls\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.895495 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.895056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f569501-9196-45e4-b2d0-c50ddd4bd231-metrics-client-ca\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.898653 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.898198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.898653 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.898566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.898810 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.898690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.899707 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.899227 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-tls\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.901335 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.901268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.901818 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.901761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1f569501-9196-45e4-b2d0-c50ddd4bd231-secret-grpc-tls\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:20.906896 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:20.906853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-287tx\" (UniqueName: \"kubernetes.io/projected/1f569501-9196-45e4-b2d0-c50ddd4bd231-kube-api-access-287tx\") pod \"thanos-querier-574db4cbc9-q4frf\" (UID: \"1f569501-9196-45e4-b2d0-c50ddd4bd231\") " pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:21.038298 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.038257 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:21.221156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.221119 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-574db4cbc9-q4frf"] Jul 02 23:12:21.225604 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:12:21.225562 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f569501_9196_45e4_b2d0_c50ddd4bd231.slice/crio-acf823761468fd7cc45d44adc04dbd9711a4219ee35024493c276c2685a2384f WatchSource:0}: Error finding container acf823761468fd7cc45d44adc04dbd9711a4219ee35024493c276c2685a2384f: Status 404 returned error can't find the container with id acf823761468fd7cc45d44adc04dbd9711a4219ee35024493c276c2685a2384f Jul 02 23:12:21.404388 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.404291 2578 generic.go:356] "Generic (PLEG): container finished" podID="1a938782-ad0d-4e31-9df9-39f888178f07" containerID="ad3ebb8b0b2c05b47272768598e1b399ffd58eebbe4190af5b34dd0ad0e651c5" exitCode=0 Jul 02 23:12:21.404543 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.404383 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwl68" event={"ID":"1a938782-ad0d-4e31-9df9-39f888178f07","Type":"ContainerDied","Data":"ad3ebb8b0b2c05b47272768598e1b399ffd58eebbe4190af5b34dd0ad0e651c5"} Jul 02 23:12:21.408376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.408345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" event={"ID":"beab0178-556e-45d2-afe0-8251cf279440","Type":"ContainerStarted","Data":"7a72885d43fa030eccc92e294cba83bf0df00c25478705ed8c45683519b388d0"} Jul 02 23:12:21.414737 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.414230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" event={"ID":"15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa","Type":"ContainerStarted","Data":"098e515e5dd06d67259aaea2875dab5ada846e43f170819af1442c3e3f60b4ec"} Jul 02 23:12:21.417847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.417821 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" event={"ID":"1f569501-9196-45e4-b2d0-c50ddd4bd231","Type":"ContainerStarted","Data":"acf823761468fd7cc45d44adc04dbd9711a4219ee35024493c276c2685a2384f"} Jul 02 23:12:21.422389 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.422363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zpnlm" event={"ID":"49f96f1f-ac38-4d3e-b171-00c95352ec56","Type":"ContainerStarted","Data":"c22988418bd5056182adb42fc5714341b37f7c850c584f0de6505049d2566440"} Jul 02 23:12:21.422497 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.422414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zpnlm" event={"ID":"49f96f1f-ac38-4d3e-b171-00c95352ec56","Type":"ContainerStarted","Data":"82dd956126a5fac6c93b054d16598da8805d21443dbae8ff0e6bbac6c778d29f"} Jul 02 23:12:21.424021 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.423999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerStarted","Data":"69beaa04cc914c557902c995b846cf19917c00b3146e4e5a8b0bfef8e3611570"} Jul 02 23:12:21.477973 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.477861 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-kdbwh" podStartSLOduration=2.094710428 podStartE2EDuration="3.477836796s" totalImagesPullingTime="1.383126368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:21.472819438 +0000 UTC m=+68.952032201" watchObservedRunningTime="2026-07-02 23:12:21.477836796 +0000 UTC m=+68.957049562" Jul 02 23:12:21.521535 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.520791 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zpnlm" podStartSLOduration=66.79599891 podStartE2EDuration="1m8.520773717s" totalImagesPullingTime="1.724774807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:21.518538109 +0000 UTC m=+68.997750884" watchObservedRunningTime="2026-07-02 23:12:21.520773717 +0000 UTC m=+68.999986495" Jul 02 23:12:21.659721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.659691 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:21.757805 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.757726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:21.938526 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:21.938297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:22.039652 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:22.039616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:22.432446 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:22.432409 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwl68" event={"ID":"1a938782-ad0d-4e31-9df9-39f888178f07","Type":"ContainerStarted","Data":"07b40dddf3c60755b2d7b3e4cb283d16987af4709dde5ed3924f582a6620d751"} Jul 02 23:12:22.432632 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:22.432475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwl68" event={"ID":"1a938782-ad0d-4e31-9df9-39f888178f07","Type":"ContainerStarted","Data":"c857bb43a46506a9b808f2d7854a4cb81442d0ba16157d4d9276fd6fbc5bf330"} Jul 02 23:12:22.453349 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:22.453294 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kwl68" podStartSLOduration=2.8011599 podStartE2EDuration="4.453277745s" totalImagesPullingTime="1.538284168s" totalInitContainerRuntime="113.833677ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:22.451998992 +0000 UTC m=+69.931211758" watchObservedRunningTime="2026-07-02 23:12:22.453277745 +0000 UTC m=+69.932490485" Jul 02 23:12:22.587317 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:22.587275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:22.649917 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:22.649835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:23.026852 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.026815 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-79f4d94c66-6c77k"] Jul 02 23:12:23.032813 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.032788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.036597 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.036572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79f4d94c66-6c77k"] Jul 02 23:12:23.037237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.037093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 23:12:23.037237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.037108 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 23:12:23.037237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.037119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 23:12:23.037237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.037132 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 23:12:23.037237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.037119 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7vpll\"" Jul 02 23:12:23.037576 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.037541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-28udq4vh314de\"" Jul 02 23:12:23.113037 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.112999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.113187 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.113050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-audit-log\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.113187 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.113153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn7ph\" (UniqueName: \"kubernetes.io/projected/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-kube-api-access-tn7ph\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.113289 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.113209 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-metrics-server-audit-profiles\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.113289 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.113242 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-secret-metrics-server-client-certs\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.113385 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.113322 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-secret-metrics-server-tls\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.113385 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.113353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-client-ca-bundle\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.213799 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.213759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-audit-log\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214001 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.213828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn7ph\" (UniqueName: \"kubernetes.io/projected/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-kube-api-access-tn7ph\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214001 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.213867 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-metrics-server-audit-profiles\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214001 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.213918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-secret-metrics-server-client-certs\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214001 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.213975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-secret-metrics-server-tls\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214001 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.213998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-client-ca-bundle\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214253 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.214055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214253 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.214171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-audit-log\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.214770 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.214746 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.215637 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.215611 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-metrics-server-audit-profiles\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.217219 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.217200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-client-ca-bundle\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.217374 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.217354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-secret-metrics-server-tls\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.217440 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.217354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-secret-metrics-server-client-certs\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.222185 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.222167 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn7ph\" (UniqueName: \"kubernetes.io/projected/ea67b982-58ff-44e4-83d0-ec7eae29f0bf-kube-api-access-tn7ph\") pod \"metrics-server-79f4d94c66-6c77k\" (UID: \"ea67b982-58ff-44e4-83d0-ec7eae29f0bf\") " pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.352012 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.351922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:23.367639 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.367601 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-858xz" Jul 02 23:12:23.478747 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.478697 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx"] Jul 02 23:12:23.478932 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.478765 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:23.481241 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.481215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:23.483418 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.483393 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 23:12:23.483522 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.483498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pmcwx\"" Jul 02 23:12:23.489503 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.489437 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx"] Jul 02 23:12:23.619130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.619042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwn59\" (UniqueName: \"kubernetes.io/projected/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-kube-api-access-dwn59\") pod \"monitoring-plugin-d5dcff7cf-kdczx\" (UID: \"8144f00f-89a5-4ab6-9698-a7f77ce32dd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:23.619130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.619127 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kdczx\" (UID: \"8144f00f-89a5-4ab6-9698-a7f77ce32dd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:23.720399 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.720359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwn59\" (UniqueName: \"kubernetes.io/projected/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-kube-api-access-dwn59\") pod \"monitoring-plugin-d5dcff7cf-kdczx\" (UID: \"8144f00f-89a5-4ab6-9698-a7f77ce32dd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:23.720587 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.720468 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kdczx\" (UID: \"8144f00f-89a5-4ab6-9698-a7f77ce32dd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:23.720647 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:23.720607 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 02 23:12:23.720704 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:12:23.720689 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-monitoring-plugin-cert podName:8144f00f-89a5-4ab6-9698-a7f77ce32dd6 nodeName:}" failed. No retries permitted until 2026-07-02 23:12:24.22066677 +0000 UTC m=+71.699879511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-kdczx" (UID: "8144f00f-89a5-4ab6-9698-a7f77ce32dd6") : secret "monitoring-plugin-cert" not found Jul 02 23:12:23.729409 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.729372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwn59\" (UniqueName: \"kubernetes.io/projected/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-kube-api-access-dwn59\") pod \"monitoring-plugin-d5dcff7cf-kdczx\" (UID: \"8144f00f-89a5-4ab6-9698-a7f77ce32dd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:23.845275 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.845205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:23.951595 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.951558 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-577ff544ff-q6hrc"] Jul 02 23:12:23.954301 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.954275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:23.957012 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.956988 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 02 23:12:23.957134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.957025 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 02 23:12:23.957247 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.957232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 02 23:12:23.957446 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.957431 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 02 23:12:23.957650 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.957612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-z9sbf\"" Jul 02 23:12:23.957650 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.957644 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 02 23:12:23.963303 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.963277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 02 23:12:23.974824 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:23.974802 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-577ff544ff-q6hrc"] Jul 02 23:12:24.023206 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.023381 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-telemeter-trusted-ca-bundle\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.023381 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-metrics-client-ca\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.023381 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-telemeter-client-tls\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.023381 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-federate-client-tls\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.023585 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-serving-certs-ca-bundle\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.023585 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-secret-telemeter-client\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.023585 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.023523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwxj\" (UniqueName: \"kubernetes.io/projected/76a303c3-1810-4491-ba98-628bdf8db462-kube-api-access-mdwxj\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-serving-certs-ca-bundle\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-secret-telemeter-client\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwxj\" (UniqueName: \"kubernetes.io/projected/76a303c3-1810-4491-ba98-628bdf8db462-kube-api-access-mdwxj\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-telemeter-trusted-ca-bundle\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-metrics-client-ca\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124712 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-telemeter-client-tls\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.124856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.124736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-federate-client-tls\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.125337 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.125292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-serving-certs-ca-bundle\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.125598 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.125458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-metrics-client-ca\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.126426 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.126399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76a303c3-1810-4491-ba98-628bdf8db462-telemeter-trusted-ca-bundle\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.127432 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.127407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.127808 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.127788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-telemeter-client-tls\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.128099 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.128055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-secret-telemeter-client\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.128289 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.128273 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/76a303c3-1810-4491-ba98-628bdf8db462-federate-client-tls\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.132838 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.132815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwxj\" (UniqueName: \"kubernetes.io/projected/76a303c3-1810-4491-ba98-628bdf8db462-kube-api-access-mdwxj\") pod \"telemeter-client-577ff544ff-q6hrc\" (UID: \"76a303c3-1810-4491-ba98-628bdf8db462\") " pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.226087 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.225988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kdczx\" (UID: \"8144f00f-89a5-4ab6-9698-a7f77ce32dd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:24.228857 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.228834 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8144f00f-89a5-4ab6-9698-a7f77ce32dd6-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-kdczx\" (UID: \"8144f00f-89a5-4ab6-9698-a7f77ce32dd6\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:24.264935 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.264898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" Jul 02 23:12:24.391617 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.391574 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:24.986479 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.986436 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:24.995276 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.995211 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:12:24.999319 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:24.999296 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.001831 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.001806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 23:12:25.002027 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.002014 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4n06ecgnm8b24\"" Jul 02 23:12:25.002663 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.002638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 23:12:25.003098 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.003075 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 23:12:25.003247 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.003227 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v29f2\"" Jul 02 23:12:25.003669 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.003650 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 23:12:25.003934 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.003914 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 23:12:25.004132 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.004115 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 23:12:25.005490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.004499 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 23:12:25.005490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.004513 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 23:12:25.005490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.004524 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 23:12:25.005490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.004673 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 23:12:25.005490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.004939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 23:12:25.005490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.005366 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 23:12:25.005964 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.005943 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 23:12:25.006223 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.006184 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 23:12:25.020295 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.020252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:12:25.134332 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134332 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-config\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134435 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j76g\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-kube-api-access-9j76g\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134614 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134749 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.134797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.135271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.135271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.135271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.135271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.134984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.135271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.135008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.135271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.135046 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.135271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.135092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.235749 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.235962 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235757 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.235962 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.235962 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235836 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.235962 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.235962 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-config\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.235962 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235947 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.235998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j76g\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-kube-api-access-9j76g\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236119 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236793 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236310 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.236793 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.236346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.237079 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.237057 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.237282 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.237259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.238394 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.238041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.238394 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.238180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.239367 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.239088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.241428 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.240084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.241428 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.240543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.241428 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.240707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.241428 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.241379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.243262 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.243241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-config\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.244441 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.244066 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.244441 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.244291 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.244441 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.244403 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.245583 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.245174 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.245583 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.245538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.246183 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.246146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.246919 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.246436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.246919 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.246855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.247173 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.247137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j76g\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-kube-api-access-9j76g\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.249291 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.249254 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.313973 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.313933 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:25.526287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.526213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:25.739367 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.739330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:25.832974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.832945 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:25.935155 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:25.935119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:26.110094 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.110005 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:12:26.127652 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.127111 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-79f4d94c66-6c77k"] Jul 02 23:12:26.149443 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.148723 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-577ff544ff-q6hrc"] Jul 02 23:12:26.186299 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.185984 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx"] Jul 02 23:12:26.209855 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.209822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:26.376742 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.376711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:26.459976 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.459928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ffbbz" event={"ID":"94dc0cbf-ca85-4907-b94a-c68cb2b7e69e","Type":"ContainerStarted","Data":"72e7d6f0664f76c5ea3cf1c2a5d2d964b8915df9b25456e4ef8b39834340b425"} Jul 02 23:12:26.460254 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.460198 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:12:26.462173 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.462154 2578 generic.go:356] "Generic (PLEG): container finished" podID="825cd44f-c098-4aaf-954d-a58d0c530308" containerID="e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b" exitCode=0 Jul 02 23:12:26.462304 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.462216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b"} Jul 02 23:12:26.463490 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.463464 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" event={"ID":"ea67b982-58ff-44e4-83d0-ec7eae29f0bf","Type":"ContainerStarted","Data":"563c895dadb41b839568404780e2c4d79654986064460bfb7d4ad6242e703df9"} Jul 02 23:12:26.465121 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.465022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wvx8s" event={"ID":"7a38af0d-67d8-4b5f-bdaf-338dd91be602","Type":"ContainerStarted","Data":"a80bda9a4ad91c3debedf1d0a18b51d99fb7eec381b683abea1aacce7d5775a6"} Jul 02 23:12:26.467302 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.467279 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" event={"ID":"beab0178-556e-45d2-afe0-8251cf279440","Type":"ContainerStarted","Data":"c8801aec23e875420802292ccc590107d38885fc5877bc03567e4577b54a0f09"} Jul 02 23:12:26.467400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.467327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" event={"ID":"beab0178-556e-45d2-afe0-8251cf279440","Type":"ContainerStarted","Data":"48bc2ef4dc674ee05a797580a9cd8ccdf80f53f4d7eebcf3a7d46f4c18706271"} Jul 02 23:12:26.467400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.467357 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" event={"ID":"beab0178-556e-45d2-afe0-8251cf279440","Type":"ContainerStarted","Data":"865348c048f688a1da5bb3925a78ad5be4c5dcde0610a5c66055bfea6a6708a5"} Jul 02 23:12:26.468487 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.468462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" event={"ID":"76a303c3-1810-4491-ba98-628bdf8db462","Type":"ContainerStarted","Data":"7a4781a9f893304298d79d98fd472d4b12c2afe7b8a80b6651407761a4369146"} Jul 02 23:12:26.470552 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.470523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" event={"ID":"1f569501-9196-45e4-b2d0-c50ddd4bd231","Type":"ContainerStarted","Data":"dd198e740036fc8cf807dfba155d062fb11c1542fbcfde04362bb2d7cdce1b21"} Jul 02 23:12:26.470656 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.470589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" event={"ID":"1f569501-9196-45e4-b2d0-c50ddd4bd231","Type":"ContainerStarted","Data":"b0e57ab16a71f5ab8ae5fee4cf174fd58de70a9b073b8ddeb4ba45e4a8735fa9"} Jul 02 23:12:26.470656 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.470632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" event={"ID":"1f569501-9196-45e4-b2d0-c50ddd4bd231","Type":"ContainerStarted","Data":"9f354663321571cdfaa73b5fabd0fab8a86cc6ce41bb7e084f62a4e30d0dc0a4"} Jul 02 23:12:26.471715 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.471694 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" event={"ID":"8144f00f-89a5-4ab6-9698-a7f77ce32dd6","Type":"ContainerStarted","Data":"2d136e4b8b7f415393d6b55c066f0f9a3e9daeb183cda0cd5c579463cc256564"} Jul 02 23:12:26.473229 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.473209 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" exitCode=0 Jul 02 23:12:26.473304 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.473244 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832"} Jul 02 23:12:26.473304 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.473293 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerStarted","Data":"d026d140fc92f7410ce7d78465d8b2ff24eb6f7ff8136f2f1d9dae578c790129"} Jul 02 23:12:26.475857 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.475783 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ffbbz" podStartSLOduration=66.857055008 podStartE2EDuration="1m13.475769482s" totalImagesPullingTime="6.618714474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:26.474379003 +0000 UTC m=+73.953591764" watchObservedRunningTime="2026-07-02 23:12:26.475769482 +0000 UTC m=+73.954982244" Jul 02 23:12:26.477029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.477006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:26.489706 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.489644 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wvx8s" podStartSLOduration=66.845105951 podStartE2EDuration="1m13.489623523s" totalImagesPullingTime="6.644517572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:11:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:26.488483874 +0000 UTC m=+73.967696637" watchObservedRunningTime="2026-07-02 23:12:26.489623523 +0000 UTC m=+73.968836289" Jul 02 23:12:26.505046 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.504995 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-jz85h" podStartSLOduration=3.499320825 podStartE2EDuration="8.504977856s" totalImagesPullingTime="5.005657031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:26.504080955 +0000 UTC m=+73.983293717" watchObservedRunningTime="2026-07-02 23:12:26.504977856 +0000 UTC m=+73.984190617" Jul 02 23:12:26.584945 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:26.584853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:27.194369 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:27.194333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:27.398271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:27.398207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:27.931485 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:27.931452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:28.032644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:28.032572 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:28.133244 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:28.133204 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:28.486820 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:28.486782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" event={"ID":"1f569501-9196-45e4-b2d0-c50ddd4bd231","Type":"ContainerStarted","Data":"d887bc9b15dc21d3c7fcf6f3f59a621a01c680d9b8f42beaecac27a99c32ad79"} Jul 02 23:12:29.208685 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:29.208623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:29.273716 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:29.273638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:31.501552 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.501519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" event={"ID":"1f569501-9196-45e4-b2d0-c50ddd4bd231","Type":"ContainerStarted","Data":"818697926abd7b90b7d2c440fcfe75bf7734d06bc6f2c31b24c1fbec056b2820"} Jul 02 23:12:31.502038 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.501583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" event={"ID":"1f569501-9196-45e4-b2d0-c50ddd4bd231","Type":"ContainerStarted","Data":"b6f2ebf8022688a42a4422a76ffcbddeaa7b95b7c53c852a51063017998c2361"} Jul 02 23:12:31.502038 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.501734 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:31.503118 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.503094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" event={"ID":"8144f00f-89a5-4ab6-9698-a7f77ce32dd6","Type":"ContainerStarted","Data":"0eb1e8719391fe775938e0aad790d324996103abce4172d97a69c1635fdc2f86"} Jul 02 23:12:31.503264 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.503239 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:31.507040 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.507012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerStarted","Data":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} Jul 02 23:12:31.507153 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.507089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerStarted","Data":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} Jul 02 23:12:31.507153 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.507126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerStarted","Data":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} Jul 02 23:12:31.507246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.507155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerStarted","Data":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} Jul 02 23:12:31.507246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.507191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerStarted","Data":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} Jul 02 23:12:31.507246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.507214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerStarted","Data":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} Jul 02 23:12:31.508180 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.508156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" Jul 02 23:12:31.509157 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.509138 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" Jul 02 23:12:31.510493 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.510476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerStarted","Data":"c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf"} Jul 02 23:12:31.510572 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.510532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerStarted","Data":"4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539"} Jul 02 23:12:31.510620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.510581 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerStarted","Data":"b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4"} Jul 02 23:12:31.510661 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.510624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerStarted","Data":"351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3"} Jul 02 23:12:31.510692 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.510669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerStarted","Data":"db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e"} Jul 02 23:12:31.510729 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.510709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerStarted","Data":"9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a"} Jul 02 23:12:31.511935 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.511915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" event={"ID":"ea67b982-58ff-44e4-83d0-ec7eae29f0bf","Type":"ContainerStarted","Data":"a26b66ded0ec87ffa78a3f3421686d08d6c6a437eab892b8a0e09bafbacb979b"} Jul 02 23:12:31.513847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.513831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" event={"ID":"76a303c3-1810-4491-ba98-628bdf8db462","Type":"ContainerStarted","Data":"e055e9a7c75bbae60e6bb28b522edeef0d9d1530df245d68e72f69fedae3b197"} Jul 02 23:12:31.513939 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.513866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" event={"ID":"76a303c3-1810-4491-ba98-628bdf8db462","Type":"ContainerStarted","Data":"0a9006579a67b6aa95613bce58ccad754612754138c3689b134f187ada66aae5"} Jul 02 23:12:31.513939 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.513907 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" event={"ID":"76a303c3-1810-4491-ba98-628bdf8db462","Type":"ContainerStarted","Data":"ba9bbfdc3d4073a6a3be0f84c6afbf255ffc721f05cf003fbf74b662bd1f48b5"} Jul 02 23:12:31.524365 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.524320 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-574db4cbc9-q4frf" podStartSLOduration=5.713040633 podStartE2EDuration="11.524304213s" totalImagesPullingTime="5.81126358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:31.52166291 +0000 UTC m=+79.000875672" watchObservedRunningTime="2026-07-02 23:12:31.524304213 +0000 UTC m=+79.003516974" Jul 02 23:12:31.557536 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.557480 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" podStartSLOduration=4.228698138 podStartE2EDuration="8.557459386s" totalImagesPullingTime="4.328761248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:31.556650565 +0000 UTC m=+79.035863328" watchObservedRunningTime="2026-07-02 23:12:31.557459386 +0000 UTC m=+79.036672151" Jul 02 23:12:31.571491 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.571444 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-kdczx" podStartSLOduration=4.293772954 podStartE2EDuration="8.571431893s" totalImagesPullingTime="4.277658939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:31.570098191 +0000 UTC m=+79.049310954" watchObservedRunningTime="2026-07-02 23:12:31.571431893 +0000 UTC m=+79.050644655" Jul 02 23:12:31.592072 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.592020 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-577ff544ff-q6hrc" podStartSLOduration=4.275304642 podStartE2EDuration="8.592001271s" totalImagesPullingTime="4.316696629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:31.590099204 +0000 UTC m=+79.069311966" watchObservedRunningTime="2026-07-02 23:12:31.592001271 +0000 UTC m=+79.071214035" Jul 02 23:12:31.620196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.620138 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.548853447 podStartE2EDuration="12.620081578s" totalImagesPullingTime="9.039861779s" totalInitContainerRuntime="31.366352ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:31.616127885 +0000 UTC m=+79.095340650" watchObservedRunningTime="2026-07-02 23:12:31.620081578 +0000 UTC m=+79.099294340" Jul 02 23:12:31.646509 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.646411 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.570914919 podStartE2EDuration="7.646390135s" totalImagesPullingTime="4.050668824s" totalInitContainerRuntime="24.806392ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:31.645060239 +0000 UTC m=+79.124273003" watchObservedRunningTime="2026-07-02 23:12:31.646390135 +0000 UTC m=+79.125602900" Jul 02 23:12:31.778742 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.778660 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:31.879571 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:31.879541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:32.229028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:32.228996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:32.326268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:32.326231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:34.551645 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:34.551523 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:35.315070 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:35.315032 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:12:38.062149 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:38.062112 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:38.161952 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:38.161922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:38.224208 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:38.224172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:38.284551 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:38.284519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:38.385506 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:38.385431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:39.617715 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:39.617673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:39.715466 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:39.715424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:43.012154 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:43.012119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:43.352487 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:43.352405 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:43.352487 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:43.352460 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:12:46.778131 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:46.778098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:46.879344 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:46.879309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:47.425706 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:47.425673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:47.478398 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:47.478359 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:52.833322 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:52.833287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:54.791682 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:54.791641 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:54.891907 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:54.891853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:54.942048 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:54.941998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:55.130480 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:55.130393 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:55.189294 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:55.189262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:12:57.483483 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:12:57.483446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ffbbz" Jul 02 23:13:01.781645 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:01.781612 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:01.837520 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:01.837490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:03.357425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:03.357390 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:13:03.361393 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:03.361371 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-79f4d94c66-6c77k" Jul 02 23:13:13.474518 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:13.474482 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:16.786515 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:16.786472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:16.886572 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:16.886538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:25.314820 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:25.314773 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:25.335642 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:25.335618 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:25.747993 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:25.747965 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:34.852685 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:34.852651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:34.954189 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:34.954142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:39.111454 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.111419 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:13:39.111845 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.111723 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="alertmanager" containerID="cri-o://9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a" gracePeriod=120 Jul 02 23:13:39.111845 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.111781 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-metric" containerID="cri-o://4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539" gracePeriod=120 Jul 02 23:13:39.111845 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.111820 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-web" containerID="cri-o://351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3" gracePeriod=120 Jul 02 23:13:39.112112 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.111820 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="config-reloader" containerID="cri-o://db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e" gracePeriod=120 Jul 02 23:13:39.112112 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.111847 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="prom-label-proxy" containerID="cri-o://c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf" gracePeriod=120 Jul 02 23:13:39.112112 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.111848 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy" containerID="cri-o://b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4" gracePeriod=120 Jul 02 23:13:39.794269 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794234 2578 generic.go:356] "Generic (PLEG): container finished" podID="825cd44f-c098-4aaf-954d-a58d0c530308" containerID="c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf" exitCode=0 Jul 02 23:13:39.794269 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794261 2578 generic.go:356] "Generic (PLEG): container finished" podID="825cd44f-c098-4aaf-954d-a58d0c530308" containerID="4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539" exitCode=0 Jul 02 23:13:39.794269 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794270 2578 generic.go:356] "Generic (PLEG): container finished" podID="825cd44f-c098-4aaf-954d-a58d0c530308" containerID="b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4" exitCode=0 Jul 02 23:13:39.794269 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794276 2578 generic.go:356] "Generic (PLEG): container finished" podID="825cd44f-c098-4aaf-954d-a58d0c530308" containerID="db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e" exitCode=0 Jul 02 23:13:39.794269 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794281 2578 generic.go:356] "Generic (PLEG): container finished" podID="825cd44f-c098-4aaf-954d-a58d0c530308" containerID="9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a" exitCode=0 Jul 02 23:13:39.794644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf"} Jul 02 23:13:39.794644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539"} Jul 02 23:13:39.794644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4"} Jul 02 23:13:39.794644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794496 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e"} Jul 02 23:13:39.794644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:39.794535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a"} Jul 02 23:13:40.349543 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.349508 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.418489 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418453 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-web\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.418651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418499 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-web-config\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.418722 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418698 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-trusted-ca-bundle\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.418760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418749 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-config-volume\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.418801 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418780 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-tls-assets\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.418860 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418810 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-metrics-client-ca\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.418931 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418864 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-metric\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.418931 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418915 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-cluster-tls-config\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.419028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418951 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.419028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.418983 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-main-db\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.419132 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.419037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-config-out\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.419132 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.419069 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-main-tls\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.419132 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.419061 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:40.419467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.419441 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:40.419621 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.419555 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:40.420488 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.419761 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rl86d\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-kube-api-access-rl86d\") pod \"825cd44f-c098-4aaf-954d-a58d0c530308\" (UID: \"825cd44f-c098-4aaf-954d-a58d0c530308\") " Jul 02 23:13:40.420488 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.420096 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.420488 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.420118 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825cd44f-c098-4aaf-954d-a58d0c530308-metrics-client-ca\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.420488 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.420132 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-alertmanager-main-db\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.422256 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.422216 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-config-volume" (OuterVolumeSpecName: "config-volume") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:40.422697 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.422526 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:40.422697 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.422674 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-config-out" (OuterVolumeSpecName: "config-out") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:40.423012 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.422972 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:40.423253 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.423178 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:40.423507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.423479 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-kube-api-access-rl86d" (OuterVolumeSpecName: "kube-api-access-rl86d") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "kube-api-access-rl86d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:40.423801 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.423767 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:40.423940 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.423846 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:40.429402 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.429369 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:40.435762 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.435693 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-web-config" (OuterVolumeSpecName: "web-config") pod "825cd44f-c098-4aaf-954d-a58d0c530308" (UID: "825cd44f-c098-4aaf-954d-a58d0c530308"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521479 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-main-tls\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521507 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rl86d\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-kube-api-access-rl86d\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521518 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521538 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-web-config\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521549 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-config-volume\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521556 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825cd44f-c098-4aaf-954d-a58d0c530308-tls-assets\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521565 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521574 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-cluster-tls-config\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521946 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521583 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825cd44f-c098-4aaf-954d-a58d0c530308-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.521946 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.521591 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825cd44f-c098-4aaf-954d-a58d0c530308-config-out\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:40.801398 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.801314 2578 generic.go:356] "Generic (PLEG): container finished" podID="825cd44f-c098-4aaf-954d-a58d0c530308" containerID="351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3" exitCode=0 Jul 02 23:13:40.801573 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.801401 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.801573 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.801397 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3"} Jul 02 23:13:40.801573 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.801559 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"825cd44f-c098-4aaf-954d-a58d0c530308","Type":"ContainerDied","Data":"69beaa04cc914c557902c995b846cf19917c00b3146e4e5a8b0bfef8e3611570"} Jul 02 23:13:40.801744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.801597 2578 scope.go:117] "RemoveContainer" containerID="c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf" Jul 02 23:13:40.810616 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.810600 2578 scope.go:117] "RemoveContainer" containerID="4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539" Jul 02 23:13:40.818161 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.818137 2578 scope.go:117] "RemoveContainer" containerID="b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4" Jul 02 23:13:40.824900 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.824862 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:13:40.825651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.825634 2578 scope.go:117] "RemoveContainer" containerID="351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3" Jul 02 23:13:40.829046 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.829025 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:13:40.833376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.833353 2578 scope.go:117] "RemoveContainer" containerID="db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e" Jul 02 23:13:40.840192 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.840175 2578 scope.go:117] "RemoveContainer" containerID="9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a" Jul 02 23:13:40.847595 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.847573 2578 scope.go:117] "RemoveContainer" containerID="e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b" Jul 02 23:13:40.854259 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854236 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:13:40.854571 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854558 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy" Jul 02 23:13:40.854619 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854573 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy" Jul 02 23:13:40.854619 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854582 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-metric" Jul 02 23:13:40.854619 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854589 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-metric" Jul 02 23:13:40.854619 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854604 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="init-config-reloader" Jul 02 23:13:40.854619 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854610 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="init-config-reloader" Jul 02 23:13:40.854619 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854618 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-web" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854623 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-web" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854630 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="alertmanager" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854635 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="alertmanager" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854641 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="prom-label-proxy" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854646 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="prom-label-proxy" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854657 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="config-reloader" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854662 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="config-reloader" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854710 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-metric" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854720 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="prom-label-proxy" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854726 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="alertmanager" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854732 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854737 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="kube-rbac-proxy-web" Jul 02 23:13:40.854788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.854744 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" containerName="config-reloader" Jul 02 23:13:40.855288 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.855165 2578 scope.go:117] "RemoveContainer" containerID="c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf" Jul 02 23:13:40.855457 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:40.855437 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf\": container with ID starting with c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf not found: ID does not exist" containerID="c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf" Jul 02 23:13:40.855502 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.855466 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf"} err="failed to get container status \"c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf\": rpc error: code = NotFound desc = could not find container \"c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf\": container with ID starting with c855e4685506f45cd0e38262d46a2528e4fd9b16ff6c654506fe37bd1d4a2adf not found: ID does not exist" Jul 02 23:13:40.855502 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.855500 2578 scope.go:117] "RemoveContainer" containerID="4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539" Jul 02 23:13:40.855764 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:40.855746 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539\": container with ID starting with 4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539 not found: ID does not exist" containerID="4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539" Jul 02 23:13:40.855831 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.855772 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539"} err="failed to get container status \"4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539\": rpc error: code = NotFound desc = could not find container \"4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539\": container with ID starting with 4e0aeb817c89d43cba7d1d370448c7137c34485a914e25823d1b84f5bee47539 not found: ID does not exist" Jul 02 23:13:40.855831 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.855793 2578 scope.go:117] "RemoveContainer" containerID="b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4" Jul 02 23:13:40.856155 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:40.856139 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4\": container with ID starting with b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4 not found: ID does not exist" containerID="b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4" Jul 02 23:13:40.856199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856160 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4"} err="failed to get container status \"b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4\": rpc error: code = NotFound desc = could not find container \"b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4\": container with ID starting with b53f5e14959d343a71ff3440de91dd8bd167b43727cc2ecf4af33632cd966ad4 not found: ID does not exist" Jul 02 23:13:40.856199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856174 2578 scope.go:117] "RemoveContainer" containerID="351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3" Jul 02 23:13:40.856395 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:40.856378 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3\": container with ID starting with 351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3 not found: ID does not exist" containerID="351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3" Jul 02 23:13:40.856436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856399 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3"} err="failed to get container status \"351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3\": rpc error: code = NotFound desc = could not find container \"351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3\": container with ID starting with 351a3becca015f0ce499025abf58bf7c588cbcea3ea012c6641b954a5bd837e3 not found: ID does not exist" Jul 02 23:13:40.856436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856412 2578 scope.go:117] "RemoveContainer" containerID="db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e" Jul 02 23:13:40.856695 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:40.856673 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e\": container with ID starting with db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e not found: ID does not exist" containerID="db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e" Jul 02 23:13:40.856779 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856702 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e"} err="failed to get container status \"db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e\": rpc error: code = NotFound desc = could not find container \"db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e\": container with ID starting with db51a30a67456257459fe3043c7bbae66dfa1266e1baa514435eefe057f9a68e not found: ID does not exist" Jul 02 23:13:40.856779 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856718 2578 scope.go:117] "RemoveContainer" containerID="9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a" Jul 02 23:13:40.856951 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:40.856932 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a\": container with ID starting with 9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a not found: ID does not exist" containerID="9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a" Jul 02 23:13:40.857036 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856953 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a"} err="failed to get container status \"9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a\": rpc error: code = NotFound desc = could not find container \"9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a\": container with ID starting with 9ee20bb62c3c9243b35423206b6969d3dd2bc3c914726d7756758a286d34f53a not found: ID does not exist" Jul 02 23:13:40.857036 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.856967 2578 scope.go:117] "RemoveContainer" containerID="e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b" Jul 02 23:13:40.857227 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:40.857203 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b\": container with ID starting with e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b not found: ID does not exist" containerID="e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b" Jul 02 23:13:40.857305 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.857235 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b"} err="failed to get container status \"e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b\": rpc error: code = NotFound desc = could not find container \"e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b\": container with ID starting with e32dd1535106c305d150cb6c51f68e98074e477f8569ef993b754171e09be20b not found: ID does not exist" Jul 02 23:13:40.858037 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.858020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.861817 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.861587 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 23:13:40.861817 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.861619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 23:13:40.861817 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.861631 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 23:13:40.861817 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.861656 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 23:13:40.861817 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.861697 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 23:13:40.862156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.861861 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 23:13:40.862156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.861967 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 23:13:40.862156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.862063 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 23:13:40.862156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.862123 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mpwhm\"" Jul 02 23:13:40.865919 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.865875 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 23:13:40.874057 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.874039 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:13:40.926694 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-config-out\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926694 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926727 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b668\" (UniqueName: \"kubernetes.io/projected/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-kube-api-access-8b668\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-web-config\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926876 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.926991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.926982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.927257 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.927022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.927257 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.927056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:40.927257 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:40.927112 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.014581 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.014552 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="825cd44f-c098-4aaf-954d-a58d0c530308" path="/var/lib/kubelet/pods/825cd44f-c098-4aaf-954d-a58d0c530308/volumes" Jul 02 23:13:41.028560 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-web-config\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028655 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028576 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028655 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028604 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028655 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028702 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.028788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.029056 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.029056 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028857 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-config-out\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.029056 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028875 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.029056 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.028918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b668\" (UniqueName: \"kubernetes.io/projected/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-kube-api-access-8b668\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.029627 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.029553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.032286 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.031991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.032374 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.032354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.032475 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.032444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.033376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.032828 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-web-config\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.033376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.033125 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.033376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.033190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.033376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.033320 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.033376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.033361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-config-volume\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.037147 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.033968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-config-out\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.037147 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.034067 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.037483 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.037462 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.037560 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.037497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b668\" (UniqueName: \"kubernetes.io/projected/11c1acf6-e59d-4849-9ddf-c2a618cf99d4-kube-api-access-8b668\") pod \"alertmanager-main-0\" (UID: \"11c1acf6-e59d-4849-9ddf-c2a618cf99d4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.169353 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.169267 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 23:13:41.305099 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.305073 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 23:13:41.307660 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:13:41.307629 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c1acf6_e59d_4849_9ddf_c2a618cf99d4.slice/crio-58943e273b425c3217dea4790833b14fe1eb45f4663c7cb81385e2a974ad3597 WatchSource:0}: Error finding container 58943e273b425c3217dea4790833b14fe1eb45f4663c7cb81385e2a974ad3597: Status 404 returned error can't find the container with id 58943e273b425c3217dea4790833b14fe1eb45f4663c7cb81385e2a974ad3597 Jul 02 23:13:41.809451 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.809418 2578 generic.go:356] "Generic (PLEG): container finished" podID="11c1acf6-e59d-4849-9ddf-c2a618cf99d4" containerID="50e439acb6f7815436041ad95bfb5d2a984aeb129a9fcb047385dac934c4a637" exitCode=0 Jul 02 23:13:41.809950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.809506 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerDied","Data":"50e439acb6f7815436041ad95bfb5d2a984aeb129a9fcb047385dac934c4a637"} Jul 02 23:13:41.809950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:41.809600 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerStarted","Data":"58943e273b425c3217dea4790833b14fe1eb45f4663c7cb81385e2a974ad3597"} Jul 02 23:13:42.818087 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:42.818055 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerStarted","Data":"ffd07be7ed7f1327ea89e286bc2802ba32a5115d7679379c55936933f9fcacfb"} Jul 02 23:13:42.818427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:42.818115 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerStarted","Data":"20e4b452ffa883a2d53e4ee25f0b41f89acada16d761e8dfadfc79d3c3b3644d"} Jul 02 23:13:42.818427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:42.818142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerStarted","Data":"b0567c2b33dbe8969ec833d28886fdff0e30250364353b4988e1375176b10085"} Jul 02 23:13:42.818427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:42.818166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerStarted","Data":"b1469e52d743a4e474c983c288a3ffa2b20c188c82391065b4c632d5bde60ab9"} Jul 02 23:13:42.818427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:42.818191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerStarted","Data":"40a09964380108874f986594d220ca395065a90054d488b7abd1f31d5fe145f9"} Jul 02 23:13:42.818427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:42.818214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"11c1acf6-e59d-4849-9ddf-c2a618cf99d4","Type":"ContainerStarted","Data":"7e52d8934c68d06c5368f2f8dca83b4b3fc439e673d2243b1d75aa617238d015"} Jul 02 23:13:42.846064 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:42.845996 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8263847970000002 podStartE2EDuration="2.845975882s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.591085ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:13:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:13:42.844776214 +0000 UTC m=+150.323988988" watchObservedRunningTime="2026-07-02 23:13:42.845975882 +0000 UTC m=+150.325188645" Jul 02 23:13:43.359460 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.359423 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:13:43.359854 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.359820 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="prometheus" containerID="cri-o://34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" gracePeriod=600 Jul 02 23:13:43.360016 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.359996 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-web" containerID="cri-o://0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" gracePeriod=600 Jul 02 23:13:43.360085 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.360003 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy" containerID="cri-o://0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" gracePeriod=600 Jul 02 23:13:43.360139 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.360090 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="thanos-sidecar" containerID="cri-o://cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" gracePeriod=600 Jul 02 23:13:43.360190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.360161 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" gracePeriod=600 Jul 02 23:13:43.360248 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.360186 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="config-reloader" containerID="cri-o://14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" gracePeriod=600 Jul 02 23:13:43.631160 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.631133 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.755397 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755366 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j76g\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-kube-api-access-9j76g\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755397 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755403 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-kubelet-serving-ca-bundle\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755422 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-db\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755446 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755471 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-metrics-client-ca\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755487 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-tls\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755525 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-serving-certs-ca-bundle\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755576 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-web-config\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755599 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-1\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.755630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755621 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-grpc-tls\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755651 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-config-out\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755678 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-metrics-client-certs\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755719 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-thanos-prometheus-http-client-file\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755743 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-tls-assets\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755771 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-2\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755819 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755844 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-kube-rbac-proxy\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.756043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.755855 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:43.756643 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.756124 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:43.756643 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.756534 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:43.758649 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.758612 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.758785 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.758751 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.759003 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.758975 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:43.759088 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759011 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.759088 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759027 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:43.759088 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759033 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-config-out" (OuterVolumeSpecName: "config-out") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:13:43.759088 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759069 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-config\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.759288 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759100 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-trusted-ca-bundle\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.759288 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759143 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-0\") pod \"ffcf7379-03f3-4508-b7f5-3eead686ec32\" (UID: \"ffcf7379-03f3-4508-b7f5-3eead686ec32\") " Jul 02 23:13:43.759494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759466 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759493 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-config-out\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759507 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-tls-assets\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759520 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759534 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759139 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759413 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759551 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-kube-rbac-proxy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759586 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759628 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-db\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759643 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-metrics-client-ca\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.759651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759655 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.760025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759452 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.760025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759463 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:43.760025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.759835 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-kube-api-access-9j76g" (OuterVolumeSpecName: "kube-api-access-9j76g") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "kube-api-access-9j76g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:13:43.761048 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.761023 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:13:43.761093 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.761027 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.761630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.761612 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.761745 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.761730 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-config" (OuterVolumeSpecName: "config") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.771986 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.771954 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-web-config" (OuterVolumeSpecName: "web-config") pod "ffcf7379-03f3-4508-b7f5-3eead686ec32" (UID: "ffcf7379-03f3-4508-b7f5-3eead686ec32"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:13:43.825496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825457 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" exitCode=0 Jul 02 23:13:43.825496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825483 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" exitCode=0 Jul 02 23:13:43.825496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825493 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" exitCode=0 Jul 02 23:13:43.825496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825500 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" exitCode=0 Jul 02 23:13:43.825496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825507 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" exitCode=0 Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825514 2578 generic.go:356] "Generic (PLEG): container finished" podID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" exitCode=0 Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825548 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825549 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825623 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825683 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825706 2578 scope.go:117] "RemoveContainer" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} Jul 02 23:13:43.826190 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.825848 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffcf7379-03f3-4508-b7f5-3eead686ec32","Type":"ContainerDied","Data":"d026d140fc92f7410ce7d78465d8b2ff24eb6f7ff8136f2f1d9dae578c790129"} Jul 02 23:13:43.834857 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.834841 2578 scope.go:117] "RemoveContainer" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.842346 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.842330 2578 scope.go:117] "RemoveContainer" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.849174 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.849154 2578 scope.go:117] "RemoveContainer" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.851807 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.851772 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:13:43.856305 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.856282 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:13:43.858995 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.858977 2578 scope.go:117] "RemoveContainer" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.860204 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860184 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860210 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-web-config\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860220 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-grpc-tls\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860228 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-metrics-client-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860236 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860245 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-config\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860253 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860451 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860261 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffcf7379-03f3-4508-b7f5-3eead686ec32-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860451 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860270 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j76g\" (UniqueName: \"kubernetes.io/projected/ffcf7379-03f3-4508-b7f5-3eead686ec32-kube-api-access-9j76g\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.860451 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.860282 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffcf7379-03f3-4508-b7f5-3eead686ec32-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:13:43.866333 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.866316 2578 scope.go:117] "RemoveContainer" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.874061 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.874043 2578 scope.go:117] "RemoveContainer" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.881995 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.881698 2578 scope.go:117] "RemoveContainer" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.882179 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:43.882051 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": container with ID starting with fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45 not found: ID does not exist" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.882179 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.882097 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} err="failed to get container status \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": rpc error: code = NotFound desc = could not find container \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": container with ID starting with fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45 not found: ID does not exist" Jul 02 23:13:43.882179 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.882124 2578 scope.go:117] "RemoveContainer" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.882515 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:43.882491 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": container with ID starting with 0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce not found: ID does not exist" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.882569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.882525 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} err="failed to get container status \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": rpc error: code = NotFound desc = could not find container \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": container with ID starting with 0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce not found: ID does not exist" Jul 02 23:13:43.882569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.882548 2578 scope.go:117] "RemoveContainer" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.882815 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:43.882794 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": container with ID starting with 0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd not found: ID does not exist" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.882877 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.882822 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} err="failed to get container status \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": rpc error: code = NotFound desc = could not find container \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": container with ID starting with 0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd not found: ID does not exist" Jul 02 23:13:43.882877 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.882840 2578 scope.go:117] "RemoveContainer" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.883154 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883132 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:13:43.883241 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:43.883151 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": container with ID starting with cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec not found: ID does not exist" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.883241 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883189 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} err="failed to get container status \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": rpc error: code = NotFound desc = could not find container \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": container with ID starting with cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec not found: ID does not exist" Jul 02 23:13:43.883241 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883209 2578 scope.go:117] "RemoveContainer" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.883470 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:43.883453 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": container with ID starting with 14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8 not found: ID does not exist" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.883504 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883476 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} err="failed to get container status \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": rpc error: code = NotFound desc = could not find container \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": container with ID starting with 14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8 not found: ID does not exist" Jul 02 23:13:43.883504 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883500 2578 scope.go:117] "RemoveContainer" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.883570 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883461 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-web" Jul 02 23:13:43.883570 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883543 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-web" Jul 02 23:13:43.883570 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883560 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="prometheus" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883571 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="prometheus" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883583 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-thanos" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883588 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-thanos" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883611 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="thanos-sidecar" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883616 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="thanos-sidecar" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883626 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="init-config-reloader" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883632 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="init-config-reloader" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883638 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="config-reloader" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883647 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="config-reloader" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883656 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy" Jul 02 23:13:43.883710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883661 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883730 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="config-reloader" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883741 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-thanos" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883748 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:43.883746 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": container with ID starting with 34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6 not found: ID does not exist" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883774 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} err="failed to get container status \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": rpc error: code = NotFound desc = could not find container \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": container with ID starting with 34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6 not found: ID does not exist" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883789 2578 scope.go:117] "RemoveContainer" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883754 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="thanos-sidecar" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883838 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="prometheus" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.883846 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" containerName="kube-rbac-proxy-web" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:13:43.884056 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": container with ID starting with e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832 not found: ID does not exist" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.884088 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832"} err="failed to get container status \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": rpc error: code = NotFound desc = could not find container \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": container with ID starting with e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832 not found: ID does not exist" Jul 02 23:13:43.884188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.884108 2578 scope.go:117] "RemoveContainer" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.884756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.884332 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} err="failed to get container status \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": rpc error: code = NotFound desc = could not find container \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": container with ID starting with fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45 not found: ID does not exist" Jul 02 23:13:43.884756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.884346 2578 scope.go:117] "RemoveContainer" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.884756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.884609 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} err="failed to get container status \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": rpc error: code = NotFound desc = could not find container \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": container with ID starting with 0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce not found: ID does not exist" Jul 02 23:13:43.884756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.884632 2578 scope.go:117] "RemoveContainer" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.885056 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885031 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} err="failed to get container status \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": rpc error: code = NotFound desc = could not find container \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": container with ID starting with 0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd not found: ID does not exist" Jul 02 23:13:43.885152 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885058 2578 scope.go:117] "RemoveContainer" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.885355 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885335 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} err="failed to get container status \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": rpc error: code = NotFound desc = could not find container \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": container with ID starting with cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec not found: ID does not exist" Jul 02 23:13:43.885433 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885356 2578 scope.go:117] "RemoveContainer" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.885619 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885597 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} err="failed to get container status \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": rpc error: code = NotFound desc = could not find container \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": container with ID starting with 14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8 not found: ID does not exist" Jul 02 23:13:43.885691 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885621 2578 scope.go:117] "RemoveContainer" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.885865 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885849 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} err="failed to get container status \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": rpc error: code = NotFound desc = could not find container \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": container with ID starting with 34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6 not found: ID does not exist" Jul 02 23:13:43.885968 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.885866 2578 scope.go:117] "RemoveContainer" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.886120 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886087 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832"} err="failed to get container status \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": rpc error: code = NotFound desc = could not find container \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": container with ID starting with e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832 not found: ID does not exist" Jul 02 23:13:43.886120 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886112 2578 scope.go:117] "RemoveContainer" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.886309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886294 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} err="failed to get container status \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": rpc error: code = NotFound desc = could not find container \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": container with ID starting with fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45 not found: ID does not exist" Jul 02 23:13:43.886352 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886309 2578 scope.go:117] "RemoveContainer" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.886514 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886496 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} err="failed to get container status \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": rpc error: code = NotFound desc = could not find container \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": container with ID starting with 0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce not found: ID does not exist" Jul 02 23:13:43.886582 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886516 2578 scope.go:117] "RemoveContainer" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.886731 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886704 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} err="failed to get container status \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": rpc error: code = NotFound desc = could not find container \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": container with ID starting with 0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd not found: ID does not exist" Jul 02 23:13:43.886768 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.886734 2578 scope.go:117] "RemoveContainer" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.887036 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887018 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} err="failed to get container status \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": rpc error: code = NotFound desc = could not find container \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": container with ID starting with cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec not found: ID does not exist" Jul 02 23:13:43.887111 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887037 2578 scope.go:117] "RemoveContainer" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.887225 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887205 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} err="failed to get container status \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": rpc error: code = NotFound desc = could not find container \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": container with ID starting with 14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8 not found: ID does not exist" Jul 02 23:13:43.887266 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887227 2578 scope.go:117] "RemoveContainer" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.887475 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887455 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} err="failed to get container status \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": rpc error: code = NotFound desc = could not find container \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": container with ID starting with 34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6 not found: ID does not exist" Jul 02 23:13:43.887508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887478 2578 scope.go:117] "RemoveContainer" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.887679 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887664 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832"} err="failed to get container status \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": rpc error: code = NotFound desc = could not find container \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": container with ID starting with e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832 not found: ID does not exist" Jul 02 23:13:43.887737 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887679 2578 scope.go:117] "RemoveContainer" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.887914 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887877 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} err="failed to get container status \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": rpc error: code = NotFound desc = could not find container \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": container with ID starting with fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45 not found: ID does not exist" Jul 02 23:13:43.887959 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.887915 2578 scope.go:117] "RemoveContainer" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.888123 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888108 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} err="failed to get container status \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": rpc error: code = NotFound desc = could not find container \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": container with ID starting with 0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce not found: ID does not exist" Jul 02 23:13:43.888123 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888122 2578 scope.go:117] "RemoveContainer" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.888348 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.888348 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888337 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} err="failed to get container status \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": rpc error: code = NotFound desc = could not find container \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": container with ID starting with 0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd not found: ID does not exist" Jul 02 23:13:43.888515 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888351 2578 scope.go:117] "RemoveContainer" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.888742 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888607 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} err="failed to get container status \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": rpc error: code = NotFound desc = could not find container \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": container with ID starting with cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec not found: ID does not exist" Jul 02 23:13:43.888742 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888637 2578 scope.go:117] "RemoveContainer" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.888944 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888925 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} err="failed to get container status \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": rpc error: code = NotFound desc = could not find container \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": container with ID starting with 14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8 not found: ID does not exist" Jul 02 23:13:43.889006 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.888944 2578 scope.go:117] "RemoveContainer" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.889167 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889147 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} err="failed to get container status \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": rpc error: code = NotFound desc = could not find container \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": container with ID starting with 34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6 not found: ID does not exist" Jul 02 23:13:43.889238 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889175 2578 scope.go:117] "RemoveContainer" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.889384 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889366 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832"} err="failed to get container status \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": rpc error: code = NotFound desc = could not find container \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": container with ID starting with e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832 not found: ID does not exist" Jul 02 23:13:43.889439 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889383 2578 scope.go:117] "RemoveContainer" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.889593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889573 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} err="failed to get container status \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": rpc error: code = NotFound desc = could not find container \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": container with ID starting with fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45 not found: ID does not exist" Jul 02 23:13:43.889649 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889592 2578 scope.go:117] "RemoveContainer" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.889838 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889818 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} err="failed to get container status \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": rpc error: code = NotFound desc = could not find container \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": container with ID starting with 0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce not found: ID does not exist" Jul 02 23:13:43.889955 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.889837 2578 scope.go:117] "RemoveContainer" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.890117 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890093 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} err="failed to get container status \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": rpc error: code = NotFound desc = could not find container \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": container with ID starting with 0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd not found: ID does not exist" Jul 02 23:13:43.890194 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890118 2578 scope.go:117] "RemoveContainer" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.890379 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890351 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} err="failed to get container status \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": rpc error: code = NotFound desc = could not find container \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": container with ID starting with cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec not found: ID does not exist" Jul 02 23:13:43.890379 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890372 2578 scope.go:117] "RemoveContainer" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.890582 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890562 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} err="failed to get container status \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": rpc error: code = NotFound desc = could not find container \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": container with ID starting with 14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8 not found: ID does not exist" Jul 02 23:13:43.890656 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890583 2578 scope.go:117] "RemoveContainer" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.890775 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890748 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 23:13:43.890848 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890794 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 23:13:43.890848 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890749 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 23:13:43.890848 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890850 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 23:13:43.891032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890794 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 23:13:43.891032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890872 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} err="failed to get container status \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": rpc error: code = NotFound desc = could not find container \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": container with ID starting with 34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6 not found: ID does not exist" Jul 02 23:13:43.891032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.890916 2578 scope.go:117] "RemoveContainer" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.891242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891122 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832"} err="failed to get container status \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": rpc error: code = NotFound desc = could not find container \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": container with ID starting with e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832 not found: ID does not exist" Jul 02 23:13:43.891242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891139 2578 scope.go:117] "RemoveContainer" containerID="fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45" Jul 02 23:13:43.891242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891160 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-v29f2\"" Jul 02 23:13:43.891242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891138 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 23:13:43.891430 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891413 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45"} err="failed to get container status \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": rpc error: code = NotFound desc = could not find container \"fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45\": container with ID starting with fd2c08691634f029204881354095532c10f8601ea3bfa301758938f666092c45 not found: ID does not exist" Jul 02 23:13:43.891475 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891432 2578 scope.go:117] "RemoveContainer" containerID="0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce" Jul 02 23:13:43.891532 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891483 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 23:13:43.891532 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891516 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 23:13:43.891633 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891570 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4n06ecgnm8b24\"" Jul 02 23:13:43.891633 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891593 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 23:13:43.891724 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891695 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 23:13:43.891724 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891709 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 23:13:43.891832 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891717 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce"} err="failed to get container status \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": rpc error: code = NotFound desc = could not find container \"0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce\": container with ID starting with 0d5ef1b1b0dd0418fc76255ef38229079b950cbdaa442ce73b442b5e0a97bbce not found: ID does not exist" Jul 02 23:13:43.891832 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.891767 2578 scope.go:117] "RemoveContainer" containerID="0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd" Jul 02 23:13:43.892081 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892056 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd"} err="failed to get container status \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": rpc error: code = NotFound desc = could not find container \"0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd\": container with ID starting with 0d32ed0c89519901104094000a1f5d2581b4d67ca253d3c6ebc261bcc82ff2dd not found: ID does not exist" Jul 02 23:13:43.892159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892084 2578 scope.go:117] "RemoveContainer" containerID="cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec" Jul 02 23:13:43.892159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892113 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 23:13:43.892324 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892299 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec"} err="failed to get container status \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": rpc error: code = NotFound desc = could not find container \"cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec\": container with ID starting with cc568f1a7d2ed7be57944df43ef4678c3df071495c006c1c85c7c7a766d92cec not found: ID does not exist" Jul 02 23:13:43.892430 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892326 2578 scope.go:117] "RemoveContainer" containerID="14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8" Jul 02 23:13:43.892606 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892580 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8"} err="failed to get container status \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": rpc error: code = NotFound desc = could not find container \"14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8\": container with ID starting with 14d73efe1560e25b25935c924d6c4234ca697c5224f5c863fd20e7be0e12e5f8 not found: ID does not exist" Jul 02 23:13:43.892606 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892601 2578 scope.go:117] "RemoveContainer" containerID="34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6" Jul 02 23:13:43.893027 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.892994 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6"} err="failed to get container status \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": rpc error: code = NotFound desc = could not find container \"34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6\": container with ID starting with 34637d315e71a861a924eb510d9a02be0fb0347d7acdfbb5ac33b0e122df91c6 not found: ID does not exist" Jul 02 23:13:43.893027 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.893016 2578 scope.go:117] "RemoveContainer" containerID="e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832" Jul 02 23:13:43.893343 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.893323 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832"} err="failed to get container status \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": rpc error: code = NotFound desc = could not find container \"e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832\": container with ID starting with e9f8349c8e773dccf8b5394cb89d46efd15ad2393c8ecfa35855de659e540832 not found: ID does not exist" Jul 02 23:13:43.894718 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.894696 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 23:13:43.898292 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.898271 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 23:13:43.902916 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.902869 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:13:43.960671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.960628 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.960671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.960672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp6jn\" (UniqueName: \"kubernetes.io/projected/f18412e4-13f7-40c7-b333-57b0ef017614-kube-api-access-gp6jn\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.960913 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.960856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.960953 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.960929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961007 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.960987 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961047 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961080 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961127 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961116 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961172 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961282 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961314 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f18412e4-13f7-40c7-b333-57b0ef017614-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961682 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-web-config\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961682 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-config\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961682 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f18412e4-13f7-40c7-b333-57b0ef017614-config-out\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961682 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:43.961800 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:43.961693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062105 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062056 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062105 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062107 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062140 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp6jn\" (UniqueName: \"kubernetes.io/projected/f18412e4-13f7-40c7-b333-57b0ef017614-kube-api-access-gp6jn\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062421 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062485 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f18412e4-13f7-40c7-b333-57b0ef017614-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-web-config\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-config\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.062760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062592 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f18412e4-13f7-40c7-b333-57b0ef017614-config-out\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.063384 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.062912 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.063384 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.063122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065208 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.063693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065208 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.063995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065208 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.064602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065208 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.065104 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065764 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.065307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f18412e4-13f7-40c7-b333-57b0ef017614-config-out\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065764 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.065399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065764 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.065621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.065764 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.065674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.066081 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.066015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.066415 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.066334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.066566 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.066549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.067284 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.067262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f18412e4-13f7-40c7-b333-57b0ef017614-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.067870 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.067851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.068093 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.068072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f18412e4-13f7-40c7-b333-57b0ef017614-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.068309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.068292 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.068309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.068302 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-web-config\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.068435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.068419 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f18412e4-13f7-40c7-b333-57b0ef017614-config\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.070101 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.070084 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp6jn\" (UniqueName: \"kubernetes.io/projected/f18412e4-13f7-40c7-b333-57b0ef017614-kube-api-access-gp6jn\") pod \"prometheus-k8s-0\" (UID: \"f18412e4-13f7-40c7-b333-57b0ef017614\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.200397 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.200371 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:13:44.339264 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.339116 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 23:13:44.831237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.831147 2578 generic.go:356] "Generic (PLEG): container finished" podID="f18412e4-13f7-40c7-b333-57b0ef017614" containerID="38e8454a69bf2c0d5efefd8d0c636eb45f5a32b864ac1a4a3cc7332ecfd76861" exitCode=0 Jul 02 23:13:44.831628 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.831236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerDied","Data":"38e8454a69bf2c0d5efefd8d0c636eb45f5a32b864ac1a4a3cc7332ecfd76861"} Jul 02 23:13:44.831628 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:44.831349 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerStarted","Data":"baa4aae2194dcc7ad410aef0bf3f32426a25815746f3537ae48b11e5e594227e"} Jul 02 23:13:45.024655 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.023851 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffcf7379-03f3-4508-b7f5-3eead686ec32" path="/var/lib/kubelet/pods/ffcf7379-03f3-4508-b7f5-3eead686ec32/volumes" Jul 02 23:13:45.839494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.839460 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerStarted","Data":"8b8b597d46667297fd221b142980c818434dc2de00af3d8102c06a912395673e"} Jul 02 23:13:45.839956 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.839534 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerStarted","Data":"41b38fbc70967f38c8833dc1a5e6e8b0c35b4b8118f85c1a96fdba3bef1165c5"} Jul 02 23:13:45.839956 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.839579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerStarted","Data":"6f4b3bb1a32f2aee53fe67f0e5b3f705a4ee8e108ca9eb05fb92632cae1548d9"} Jul 02 23:13:45.839956 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.839618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerStarted","Data":"d57279576988b6192aad25aad8308b2368941a5c9f851d8e98e729318e4cad52"} Jul 02 23:13:45.839956 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.839659 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerStarted","Data":"77f8c18a3aecfcf155ed64c54f3a5b6b05832316a7782b8ac48aee4730534f3d"} Jul 02 23:13:45.839956 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.839698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f18412e4-13f7-40c7-b333-57b0ef017614","Type":"ContainerStarted","Data":"807754dd625d39f85c707dfb38890df6e18fc353f647820596095c0683c06dba"} Jul 02 23:13:45.867220 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:45.867170 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.847296615 podStartE2EDuration="2.867154284s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.857669ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:13:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:13:45.865727077 +0000 UTC m=+153.344939839" watchObservedRunningTime="2026-07-02 23:13:45.867154284 +0000 UTC m=+153.346367046" Jul 02 23:13:46.804684 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:46.804651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:46.905735 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:46.905700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:13:49.201538 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:13:49.201503 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:14:01.794712 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:01.794662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:01.891109 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:01.891076 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:06.125530 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:06.125434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:06.195904 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:06.195864 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:17.177618 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:17.177571 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:17.277930 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:17.277869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:18.854925 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:18.854860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:18.946822 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:18.946789 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:33.538226 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:33.538184 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:33.611460 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:33.611426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:44.201335 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:44.201291 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:14:44.217260 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:44.217239 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:14:45.092453 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:45.092420 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 23:14:45.634923 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:45.634868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:46.496198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:46.496142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:49.254394 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:49.254355 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:49.353698 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:49.353663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:52.016579 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.016540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:52.107192 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.107157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:52.151498 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.151455 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dcmj9"] Jul 02 23:14:52.155755 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.155734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.159930 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.159904 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 23:14:52.160508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.160491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 23:14:52.160508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.160504 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6zzjk\"" Jul 02 23:14:52.170212 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.170190 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dcmj9"] Jul 02 23:14:52.253871 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.253840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e771c386-180a-4a5e-b30f-b9429046650a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dcmj9\" (UID: \"e771c386-180a-4a5e-b30f-b9429046650a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.254048 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.253970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh676\" (UniqueName: \"kubernetes.io/projected/e771c386-180a-4a5e-b30f-b9429046650a-kube-api-access-gh676\") pod \"cert-manager-webhook-6486ffd997-dcmj9\" (UID: \"e771c386-180a-4a5e-b30f-b9429046650a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.354814 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.354733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e771c386-180a-4a5e-b30f-b9429046650a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dcmj9\" (UID: \"e771c386-180a-4a5e-b30f-b9429046650a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.354983 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.354826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh676\" (UniqueName: \"kubernetes.io/projected/e771c386-180a-4a5e-b30f-b9429046650a-kube-api-access-gh676\") pod \"cert-manager-webhook-6486ffd997-dcmj9\" (UID: \"e771c386-180a-4a5e-b30f-b9429046650a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.365727 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.365697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e771c386-180a-4a5e-b30f-b9429046650a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dcmj9\" (UID: \"e771c386-180a-4a5e-b30f-b9429046650a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.366114 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.366094 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh676\" (UniqueName: \"kubernetes.io/projected/e771c386-180a-4a5e-b30f-b9429046650a-kube-api-access-gh676\") pod \"cert-manager-webhook-6486ffd997-dcmj9\" (UID: \"e771c386-180a-4a5e-b30f-b9429046650a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.483659 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.483627 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:52.510197 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.510170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:52.617761 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.617619 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dcmj9"] Jul 02 23:14:52.620503 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:14:52.620467 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode771c386_180a_4a5e_b30f_b9429046650a.slice/crio-23990620d6387103440994bedef90422d0a2494bd595511474f0a4320a3ea150 WatchSource:0}: Error finding container 23990620d6387103440994bedef90422d0a2494bd595511474f0a4320a3ea150: Status 404 returned error can't find the container with id 23990620d6387103440994bedef90422d0a2494bd595511474f0a4320a3ea150 Jul 02 23:14:52.645184 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:52.645159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:53.108392 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:53.108358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" event={"ID":"e771c386-180a-4a5e-b30f-b9429046650a","Type":"ContainerStarted","Data":"23990620d6387103440994bedef90422d0a2494bd595511474f0a4320a3ea150"} Jul 02 23:14:54.010345 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.010303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:54.392796 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.392697 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:54.443555 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.443523 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j825j"] Jul 02 23:14:54.447303 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.447281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.450195 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.450174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-kddds\"" Jul 02 23:14:54.457069 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.457047 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j825j"] Jul 02 23:14:54.478202 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.478037 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0529b1d7-7379-4396-9c54-c0aae6c7bc70-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j825j\" (UID: \"0529b1d7-7379-4396-9c54-c0aae6c7bc70\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.478202 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.478083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxhm\" (UniqueName: \"kubernetes.io/projected/0529b1d7-7379-4396-9c54-c0aae6c7bc70-kube-api-access-qwxhm\") pod \"cert-manager-cainjector-559cdd8c87-j825j\" (UID: \"0529b1d7-7379-4396-9c54-c0aae6c7bc70\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.579495 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.579459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0529b1d7-7379-4396-9c54-c0aae6c7bc70-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j825j\" (UID: \"0529b1d7-7379-4396-9c54-c0aae6c7bc70\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.579495 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.579495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxhm\" (UniqueName: \"kubernetes.io/projected/0529b1d7-7379-4396-9c54-c0aae6c7bc70-kube-api-access-qwxhm\") pod \"cert-manager-cainjector-559cdd8c87-j825j\" (UID: \"0529b1d7-7379-4396-9c54-c0aae6c7bc70\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.594842 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.594814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxhm\" (UniqueName: \"kubernetes.io/projected/0529b1d7-7379-4396-9c54-c0aae6c7bc70-kube-api-access-qwxhm\") pod \"cert-manager-cainjector-559cdd8c87-j825j\" (UID: \"0529b1d7-7379-4396-9c54-c0aae6c7bc70\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.596027 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.596007 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0529b1d7-7379-4396-9c54-c0aae6c7bc70-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-j825j\" (UID: \"0529b1d7-7379-4396-9c54-c0aae6c7bc70\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.757143 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.757103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" Jul 02 23:14:54.925386 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:54.925322 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-j825j"] Jul 02 23:14:54.929715 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:14:54.929679 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0529b1d7_7379_4396_9c54_c0aae6c7bc70.slice/crio-1fe7791ddc8c0a779fb178d729229c412737a1251b517bc690576d81af8f6aae WatchSource:0}: Error finding container 1fe7791ddc8c0a779fb178d729229c412737a1251b517bc690576d81af8f6aae: Status 404 returned error can't find the container with id 1fe7791ddc8c0a779fb178d729229c412737a1251b517bc690576d81af8f6aae Jul 02 23:14:55.118192 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:55.118111 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" event={"ID":"0529b1d7-7379-4396-9c54-c0aae6c7bc70","Type":"ContainerStarted","Data":"1fe7791ddc8c0a779fb178d729229c412737a1251b517bc690576d81af8f6aae"} Jul 02 23:14:55.235079 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:55.235049 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:55.297517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:55.297477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:14:58.136007 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:58.135968 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" event={"ID":"e771c386-180a-4a5e-b30f-b9429046650a","Type":"ContainerStarted","Data":"2d4b31a32cf364c4114b9f94a60d2bcb9bb59394b25b879b6fb74f73b5ad4be4"} Jul 02 23:14:58.136446 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:58.136045 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:14:58.154933 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:14:58.154866 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" podStartSLOduration=1.173283687 podStartE2EDuration="6.15485017s" totalImagesPullingTime="4.981566483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:14:58.152842158 +0000 UTC m=+225.632054921" watchObservedRunningTime="2026-07-02 23:14:58.15485017 +0000 UTC m=+225.634062929" Jul 02 23:15:00.145384 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:00.145341 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" event={"ID":"0529b1d7-7379-4396-9c54-c0aae6c7bc70","Type":"ContainerStarted","Data":"e58a51f6f11ef6fb4ca5544d14e32d18dd122b495f6be5bd4a731a132205bad6"} Jul 02 23:15:00.163317 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:00.163259 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-j825j" podStartSLOduration=1.459974929 podStartE2EDuration="6.163239802s" totalImagesPullingTime="4.703264873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:00.161182602 +0000 UTC m=+227.640395364" watchObservedRunningTime="2026-07-02 23:15:00.163239802 +0000 UTC m=+227.642452566" Jul 02 23:15:00.436165 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:00.436134 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:00.524787 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:00.524758 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:02.608019 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:02.607988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:02.748811 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:02.748784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:02.854051 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:02.854016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:04.141663 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:04.141635 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dcmj9" Jul 02 23:15:04.234588 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:04.234559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:13.820558 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:13.820490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:13.916016 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:13.915987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:19.027729 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:19.027694 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:19.132878 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:19.132836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:21.420275 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:21.420237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:33.665713 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:33.665595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:33.808592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:33.808559 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:34.278931 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:34.278897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:34.872974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:34.872942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:35.143779 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.143695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:35.177055 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.177024 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49"] Jul 02 23:15:35.179566 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.179544 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.189312 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.189098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 23:15:35.189312 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.189109 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 23:15:35.189312 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.189176 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kfpkl\"" Jul 02 23:15:35.240745 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.240711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkf4k\" (UniqueName: \"kubernetes.io/projected/693dfb54-233d-44c1-b85c-0187af57337d-kube-api-access-dkf4k\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.240910 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.240748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/693dfb54-233d-44c1-b85c-0187af57337d-manifests\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.240910 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.240766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/693dfb54-233d-44c1-b85c-0187af57337d-tmp\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.240910 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.240850 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dfb54-233d-44c1-b85c-0187af57337d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.241087 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.240963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/693dfb54-233d-44c1-b85c-0187af57337d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.246891 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.246864 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 23:15:35.246998 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.246864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 23:15:35.335662 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.335631 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49"] Jul 02 23:15:35.342292 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.342264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/693dfb54-233d-44c1-b85c-0187af57337d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.342436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.342320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkf4k\" (UniqueName: \"kubernetes.io/projected/693dfb54-233d-44c1-b85c-0187af57337d-kube-api-access-dkf4k\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.342436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.342345 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/693dfb54-233d-44c1-b85c-0187af57337d-manifests\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.342436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.342361 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/693dfb54-233d-44c1-b85c-0187af57337d-tmp\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.342436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.342397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dfb54-233d-44c1-b85c-0187af57337d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.342859 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.342829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/693dfb54-233d-44c1-b85c-0187af57337d-manifests\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.344788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.344768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/693dfb54-233d-44c1-b85c-0187af57337d-tmp\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.345072 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.345057 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/693dfb54-233d-44c1-b85c-0187af57337d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.345134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.345114 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/693dfb54-233d-44c1-b85c-0187af57337d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.377278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.377253 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkf4k\" (UniqueName: \"kubernetes.io/projected/693dfb54-233d-44c1-b85c-0187af57337d-kube-api-access-dkf4k\") pod \"opendatahub-operator-controller-manager-7d98bc9d58-pht49\" (UID: \"693dfb54-233d-44c1-b85c-0187af57337d\") " pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.493156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.493126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:35.661178 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.661129 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49"] Jul 02 23:15:35.664179 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:15:35.664150 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693dfb54_233d_44c1_b85c_0187af57337d.slice/crio-4d407cb4bcc8c39ed40564e3292b82ac20744212de652b29fd5dd56910059a8b WatchSource:0}: Error finding container 4d407cb4bcc8c39ed40564e3292b82ac20744212de652b29fd5dd56910059a8b: Status 404 returned error can't find the container with id 4d407cb4bcc8c39ed40564e3292b82ac20744212de652b29fd5dd56910059a8b Jul 02 23:15:35.713069 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.713039 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:35.831514 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:35.831434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:36.021271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:36.021242 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:36.202055 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:36.202012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:36.291514 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:36.291473 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" event={"ID":"693dfb54-233d-44c1-b85c-0187af57337d","Type":"ContainerStarted","Data":"4d407cb4bcc8c39ed40564e3292b82ac20744212de652b29fd5dd56910059a8b"} Jul 02 23:15:36.401515 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:36.401432 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:39.307769 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:39.307728 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" event={"ID":"693dfb54-233d-44c1-b85c-0187af57337d","Type":"ContainerStarted","Data":"d206e823500cc095a3e9f8dddd27e28c8af946a868e86c536389fc93b4e4651b"} Jul 02 23:15:40.313936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:40.313869 2578 generic.go:356] "Generic (PLEG): container finished" podID="693dfb54-233d-44c1-b85c-0187af57337d" containerID="d206e823500cc095a3e9f8dddd27e28c8af946a868e86c536389fc93b4e4651b" exitCode=0 Jul 02 23:15:40.313936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:40.313926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" event={"ID":"693dfb54-233d-44c1-b85c-0187af57337d","Type":"ContainerDied","Data":"d206e823500cc095a3e9f8dddd27e28c8af946a868e86c536389fc93b4e4651b"} Jul 02 23:15:41.321107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:41.321061 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" event={"ID":"693dfb54-233d-44c1-b85c-0187af57337d","Type":"ContainerStarted","Data":"6b2c1946b6a936932a277759d1b25dce52ee7402690523168108f06abb3fae5f"} Jul 02 23:15:41.321515 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:41.321196 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:41.352465 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:41.352406 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" podStartSLOduration=2.151883174 podStartE2EDuration="6.35238416s" totalImagesPullingTime="3.132378567s" totalInitContainerRuntime="1.068122419s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:41.350846359 +0000 UTC m=+268.830059123" watchObservedRunningTime="2026-07-02 23:15:41.35238416 +0000 UTC m=+268.831596923" Jul 02 23:15:42.046409 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:42.046379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:42.236076 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:42.236048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:45.976212 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:45.976181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:46.079058 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:46.079026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:52.329900 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:52.329856 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d98bc9d58-pht49" Jul 02 23:15:53.374069 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:53.374037 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:54.640711 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:54.640668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:56.269039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:56.269003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:57.469160 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:57.469121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:58.186909 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:58.186853 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:58.341270 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:58.341234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:58.519091 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:58.519002 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:15:59.761186 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:15:59.761149 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:01.117397 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.117364 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4"] Jul 02 23:16:01.128728 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.128699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.130204 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.130176 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4"] Jul 02 23:16:01.131095 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.131073 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 23:16:01.131213 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.131144 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 23:16:01.132172 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.131738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 23:16:01.132172 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.131757 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 23:16:01.132172 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.131989 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ljqph\"" Jul 02 23:16:01.132172 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.132073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 23:16:01.286474 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.286437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee0719f4-5737-409e-985d-fc851016edce-cert\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.286631 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.286486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ee0719f4-5737-409e-985d-fc851016edce-manager-config\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.286631 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.286585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee0719f4-5737-409e-985d-fc851016edce-metrics-cert\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.286631 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.286626 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpvjs\" (UniqueName: \"kubernetes.io/projected/ee0719f4-5737-409e-985d-fc851016edce-kube-api-access-lpvjs\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.387505 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.387422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee0719f4-5737-409e-985d-fc851016edce-cert\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.387505 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.387459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ee0719f4-5737-409e-985d-fc851016edce-manager-config\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.387739 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.387660 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee0719f4-5737-409e-985d-fc851016edce-metrics-cert\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.387739 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.387705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpvjs\" (UniqueName: \"kubernetes.io/projected/ee0719f4-5737-409e-985d-fc851016edce-kube-api-access-lpvjs\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.388329 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.388301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ee0719f4-5737-409e-985d-fc851016edce-manager-config\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.390108 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.390075 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee0719f4-5737-409e-985d-fc851016edce-metrics-cert\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.390219 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.390143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee0719f4-5737-409e-985d-fc851016edce-cert\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.396458 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.396426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpvjs\" (UniqueName: \"kubernetes.io/projected/ee0719f4-5737-409e-985d-fc851016edce-kube-api-access-lpvjs\") pod \"lws-controller-manager-747bc6df4d-nfdf4\" (UID: \"ee0719f4-5737-409e-985d-fc851016edce\") " pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.440445 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.440419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:01.583054 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:01.583011 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4"] Jul 02 23:16:01.586185 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:16:01.586156 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0719f4_5737_409e_985d_fc851016edce.slice/crio-766a14fa62369e9dbd235faedc49c2e7e4340249e8574a38088186aa2752b50f WatchSource:0}: Error finding container 766a14fa62369e9dbd235faedc49c2e7e4340249e8574a38088186aa2752b50f: Status 404 returned error can't find the container with id 766a14fa62369e9dbd235faedc49c2e7e4340249e8574a38088186aa2752b50f Jul 02 23:16:02.417792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:02.417751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" event={"ID":"ee0719f4-5737-409e-985d-fc851016edce","Type":"ContainerStarted","Data":"766a14fa62369e9dbd235faedc49c2e7e4340249e8574a38088186aa2752b50f"} Jul 02 23:16:02.923768 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:02.923685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:03.177119 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.176987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:03.963356 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.963325 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc"] Jul 02 23:16:03.974387 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.974356 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:03.977135 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.977111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 23:16:03.977708 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.977686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 23:16:03.977708 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.977691 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 23:16:03.978118 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.978098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6cfx8\"" Jul 02 23:16:03.988820 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:03.988799 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc"] Jul 02 23:16:04.013663 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.013633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:04.116191 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116370 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116370 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116370 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116287 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftst7\" (UniqueName: \"kubernetes.io/projected/6920b345-8266-453c-8e1c-65aaa4cef0c8-kube-api-access-ftst7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116370 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920b345-8266-453c-8e1c-65aaa4cef0c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.116592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.116487 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.127614 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.127580 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj"] Jul 02 23:16:04.131742 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.131719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.141347 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.140551 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jc486\"" Jul 02 23:16:04.141347 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.140572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 23:16:04.141347 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.140611 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 23:16:04.141347 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.140574 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 23:16:04.167727 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.167698 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj"] Jul 02 23:16:04.217949 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.217842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.217949 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.217907 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.217949 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.217929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.217964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftst7\" (UniqueName: \"kubernetes.io/projected/6920b345-8266-453c-8e1c-65aaa4cef0c8-kube-api-access-ftst7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.217991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920b345-8266-453c-8e1c-65aaa4cef0c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218492 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218282 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218492 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218492 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218434 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.218720 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.218551 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.219315 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.219277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6920b345-8266-453c-8e1c-65aaa4cef0c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.220856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.220837 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.221386 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.221363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.247738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.247711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6920b345-8266-453c-8e1c-65aaa4cef0c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.248032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.248003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftst7\" (UniqueName: \"kubernetes.io/projected/6920b345-8266-453c-8e1c-65aaa4cef0c8-kube-api-access-ftst7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf448jkc\" (UID: \"6920b345-8266-453c-8e1c-65aaa4cef0c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.287739 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.287685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:04.319182 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.319154 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw8gv\" (UniqueName: \"kubernetes.io/projected/31412cba-b3b0-4bd1-9534-93a0a3909b6d-kube-api-access-vw8gv\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.319324 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.319230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.319324 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.319252 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.319324 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.319285 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/31412cba-b3b0-4bd1-9534-93a0a3909b6d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.319496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.319367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.319496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.319401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.319496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.319430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.420713 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.420673 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.420926 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.420726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.420926 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.420780 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/31412cba-b3b0-4bd1-9534-93a0a3909b6d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.420926 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.420824 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.420926 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.420852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.420926 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.420912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.421211 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.420966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8gv\" (UniqueName: \"kubernetes.io/projected/31412cba-b3b0-4bd1-9534-93a0a3909b6d-kube-api-access-vw8gv\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.421585 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.421561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.424263 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.424235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.424380 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.424310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.424380 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.424334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/31412cba-b3b0-4bd1-9534-93a0a3909b6d-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.425592 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.425568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/31412cba-b3b0-4bd1-9534-93a0a3909b6d-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.443985 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.443954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw8gv\" (UniqueName: \"kubernetes.io/projected/31412cba-b3b0-4bd1-9534-93a0a3909b6d-kube-api-access-vw8gv\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.458033 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.458013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31412cba-b3b0-4bd1-9534-93a0a3909b6d-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-24dhj\" (UID: \"31412cba-b3b0-4bd1-9534-93a0a3909b6d\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.534092 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.534057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:04.612753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.612671 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc"] Jul 02 23:16:04.617646 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:16:04.617619 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6920b345_8266_453c_8e1c_65aaa4cef0c8.slice/crio-69b44e2872f916962ed8bea5492964aeb8c2b0f4ca90e8412aca604d6b5a7206 WatchSource:0}: Error finding container 69b44e2872f916962ed8bea5492964aeb8c2b0f4ca90e8412aca604d6b5a7206: Status 404 returned error can't find the container with id 69b44e2872f916962ed8bea5492964aeb8c2b0f4ca90e8412aca604d6b5a7206 Jul 02 23:16:04.743801 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.743702 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:04.760574 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.760544 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:04.899142 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:04.899108 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj"] Jul 02 23:16:04.902784 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:16:04.902759 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31412cba_b3b0_4bd1_9534_93a0a3909b6d.slice/crio-16fc760d769f3a5544d929d22b679dade0e8aa81f699bb44e73f459c9403b6f7 WatchSource:0}: Error finding container 16fc760d769f3a5544d929d22b679dade0e8aa81f699bb44e73f459c9403b6f7: Status 404 returned error can't find the container with id 16fc760d769f3a5544d929d22b679dade0e8aa81f699bb44e73f459c9403b6f7 Jul 02 23:16:05.434058 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:05.434025 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" event={"ID":"31412cba-b3b0-4bd1-9534-93a0a3909b6d","Type":"ContainerStarted","Data":"16fc760d769f3a5544d929d22b679dade0e8aa81f699bb44e73f459c9403b6f7"} Jul 02 23:16:05.435395 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:05.435377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" event={"ID":"ee0719f4-5737-409e-985d-fc851016edce","Type":"ContainerStarted","Data":"c710b9bd76ac9dc4485521f3da1eae56cdf679ecfe322bba425ba7c865eb8489"} Jul 02 23:16:05.435481 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:05.435442 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:05.436530 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:05.436502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" event={"ID":"6920b345-8266-453c-8e1c-65aaa4cef0c8","Type":"ContainerStarted","Data":"69b44e2872f916962ed8bea5492964aeb8c2b0f4ca90e8412aca604d6b5a7206"} Jul 02 23:16:05.482651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:05.482590 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" podStartSLOduration=1.555862547 podStartE2EDuration="4.48257135s" totalImagesPullingTime="2.926708803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:05.481410696 +0000 UTC m=+292.960623458" watchObservedRunningTime="2026-07-02 23:16:05.48257135 +0000 UTC m=+292.961784111" Jul 02 23:16:05.485765 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:05.485738 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:05.934802 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:16:05.934739 2578 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/40/40c83ebfd976fb12de546e29831f0f7dfb6972ccb7ae93da70a16f557dfa208e?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260702%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260702T231605Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=66fc903784bb364d5787e4c98a76b0bc8148623eb8f3593c75348ea08897e520®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=openshift-service-mesh----istio-pilot-rhel9&akamai_signature=exp=1783035065~hmac=abe69867460a39cc5129b2e17a29a6f5350aff813fdc56426e0062758a6ed9a8\": EOF; artifact err: provided artifact is a container image" image="registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" Jul 02 23:16:05.935054 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:16:05.934918 2578 kuberuntime_manager.go:1459] "Unhandled Error" err="container discovery start failed in pod istiod-openshift-gateway-94bb8fbfd-24dhj_openshift-ingress(31412cba-b3b0-4bd1-9534-93a0a3909b6d): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \"https://cdn01.quay.io/quayio-production-s3/sha256/40/40c83ebfd976fb12de546e29831f0f7dfb6972ccb7ae93da70a16f557dfa208e?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260702%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260702T231605Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=66fc903784bb364d5787e4c98a76b0bc8148623eb8f3593c75348ea08897e520®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=openshift-service-mesh----istio-pilot-rhel9&akamai_signature=exp=1783035065~hmac=abe69867460a39cc5129b2e17a29a6f5350aff813fdc56426e0062758a6ed9a8\": EOF; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 02 23:16:05.935054 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:16:05.934980 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"discovery\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/40/40c83ebfd976fb12de546e29831f0f7dfb6972ccb7ae93da70a16f557dfa208e?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260702%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260702T231605Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=66fc903784bb364d5787e4c98a76b0bc8148623eb8f3593c75348ea08897e520®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=openshift-service-mesh----istio-pilot-rhel9&akamai_signature=exp=1783035065~hmac=abe69867460a39cc5129b2e17a29a6f5350aff813fdc56426e0062758a6ed9a8\\\": EOF; artifact err: provided artifact is a container image\"" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" podUID="31412cba-b3b0-4bd1-9534-93a0a3909b6d" Jul 02 23:16:06.442405 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:16:06.442368 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"discovery\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: Get \\\"https://cdn01.quay.io/quayio-production-s3/sha256/40/40c83ebfd976fb12de546e29831f0f7dfb6972ccb7ae93da70a16f557dfa208e?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260702%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260702T231605Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=66fc903784bb364d5787e4c98a76b0bc8148623eb8f3593c75348ea08897e520®ion=us-east-1&namespace=redhat-prod&username=redhat-prod+registry_proxy&repo_name=openshift-service-mesh----istio-pilot-rhel9&akamai_signature=exp=1783035065~hmac=abe69867460a39cc5129b2e17a29a6f5350aff813fdc56426e0062758a6ed9a8\\\": EOF; artifact err: provided artifact is a container image\"" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" podUID="31412cba-b3b0-4bd1-9534-93a0a3909b6d" Jul 02 23:16:08.262345 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:08.262313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:08.487271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:08.487239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:08.686628 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:08.686595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:09.023296 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:09.023213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:09.262237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:09.262203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:09.472335 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:09.472299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:09.638727 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:09.638693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:11.615082 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:11.615026 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:16:11.615348 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:11.615125 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:16:11.615348 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:11.615156 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:16:12.474376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:12.474339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" event={"ID":"6920b345-8266-453c-8e1c-65aaa4cef0c8","Type":"ContainerStarted","Data":"fa8806f2f5c04464bc1633b01aeeca8a48a048336d2d4e4f43b49005245fe8ce"} Jul 02 23:16:12.514246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:12.514198 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" podStartSLOduration=2.52502677 podStartE2EDuration="9.514182718s" totalImagesPullingTime="6.989155948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:12.51183677 +0000 UTC m=+299.991049531" watchObservedRunningTime="2026-07-02 23:16:12.514182718 +0000 UTC m=+299.993395547" Jul 02 23:16:12.871452 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:12.871425 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 23:16:13.288616 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:13.288575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:13.293210 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:13.293187 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:13.479556 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:13.479526 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:13.480438 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:13.480420 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf448jkc" Jul 02 23:16:16.443537 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:16.443506 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-747bc6df4d-nfdf4" Jul 02 23:16:20.010704 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:20.010568 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 23:16:29.828624 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:29.828564 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:16:29.828896 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:29.828659 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:16:30.567192 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:30.567154 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" event={"ID":"31412cba-b3b0-4bd1-9534-93a0a3909b6d","Type":"ContainerStarted","Data":"80d32c38c252f9e7c9ba6a5d1c6bdd15344d3c4f094eda25f29fc990e1dd0315"} Jul 02 23:16:30.567468 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:30.567446 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:30.568936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:30.568906 2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-24dhj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 23:16:30.569054 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:30.568963 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" podUID="31412cba-b3b0-4bd1-9534-93a0a3909b6d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 23:16:30.591226 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:30.590688 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" podStartSLOduration=1.667091519 podStartE2EDuration="26.590668827s" totalImagesPullingTime="24.923577308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 23:16:30.588607832 +0000 UTC m=+318.067820595" watchObservedRunningTime="2026-07-02 23:16:30.590668827 +0000 UTC m=+318.069881591" Jul 02 23:16:31.573153 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:31.573126 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-24dhj" Jul 02 23:16:56.244728 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:56.244693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:56.345268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:56.345235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:16:56.452874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:16:56.452834 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:19.968695 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:19.968663 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:22.868897 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:22.868855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:25.028320 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:25.028279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:25.387766 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:25.387693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:26.043912 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:26.043868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:26.156821 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:26.156785 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:28.066115 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:28.066080 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:30.221794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:30.221757 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:30.377600 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:30.377568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:32.446414 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:32.446374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:32.564390 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:32.564356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:32.738423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:32.738342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:35.592299 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:35.592264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:35.710737 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:35.710693 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:36.680687 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:36.680654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:36.837661 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:36.837631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:42.946227 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:42.946198 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm"] Jul 02 23:17:42.949678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:42.949661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:42.952507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:42.952477 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 23:17:42.953130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:42.953106 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 23:17:42.953189 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:42.953111 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rh4ws\"" Jul 02 23:17:42.970786 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:42.970753 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm"] Jul 02 23:17:43.027162 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.027131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwp8n\" (UniqueName: \"kubernetes.io/projected/a57b9e82-b0a9-4b19-ac66-7733de022d4e-kube-api-access-zwp8n\") pod \"kuadrant-operator-controller-manager-86878c769f-hfxcm\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:43.027364 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.027246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57b9e82-b0a9-4b19-ac66-7733de022d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hfxcm\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:43.128245 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.128205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwp8n\" (UniqueName: \"kubernetes.io/projected/a57b9e82-b0a9-4b19-ac66-7733de022d4e-kube-api-access-zwp8n\") pod \"kuadrant-operator-controller-manager-86878c769f-hfxcm\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:43.128423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.128283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57b9e82-b0a9-4b19-ac66-7733de022d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hfxcm\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:43.128653 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.128633 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57b9e82-b0a9-4b19-ac66-7733de022d4e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hfxcm\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:43.146628 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.146603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwp8n\" (UniqueName: \"kubernetes.io/projected/a57b9e82-b0a9-4b19-ac66-7733de022d4e-kube-api-access-zwp8n\") pod \"kuadrant-operator-controller-manager-86878c769f-hfxcm\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:43.260551 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.260453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:43.419179 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.419085 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm"] Jul 02 23:17:43.422092 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:17:43.422068 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57b9e82_b0a9_4b19_ac66_7733de022d4e.slice/crio-d74baf9a6bbc1312a81f4776be223119814f97b1b30a39799ffe67470b52b89f WatchSource:0}: Error finding container d74baf9a6bbc1312a81f4776be223119814f97b1b30a39799ffe67470b52b89f: Status 404 returned error can't find the container with id d74baf9a6bbc1312a81f4776be223119814f97b1b30a39799ffe67470b52b89f Jul 02 23:17:43.904186 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:43.904155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" event={"ID":"a57b9e82-b0a9-4b19-ac66-7733de022d4e","Type":"ContainerStarted","Data":"d74baf9a6bbc1312a81f4776be223119814f97b1b30a39799ffe67470b52b89f"} Jul 02 23:17:44.853296 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:44.853255 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:44.962782 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:44.962740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:47.365400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:47.365322 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:47.558420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:47.558378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:47.698968 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:47.698937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:47.819658 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:47.819623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:47.925074 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:47.925037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" event={"ID":"a57b9e82-b0a9-4b19-ac66-7733de022d4e","Type":"ContainerStarted","Data":"4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec"} Jul 02 23:17:47.925256 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:47.925130 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:17:47.964657 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:47.964547 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" podStartSLOduration=2.342526112 podStartE2EDuration="5.964530616s" totalImagesPullingTime="3.622004504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:17:47.96113847 +0000 UTC m=+395.440351243" watchObservedRunningTime="2026-07-02 23:17:47.964530616 +0000 UTC m=+395.443743377" Jul 02 23:17:52.002448 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:52.002399 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:52.108263 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:52.108234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:56.208377 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:56.208344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:56.328500 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:56.328422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:17:58.932103 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:17:58.932070 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:18:05.190387 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:05.190343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:05.298753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:05.298711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:07.701092 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:07.701056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:07.818247 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:07.818215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:12.381267 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:12.381225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:12.483608 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:12.483564 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:15.395683 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:15.395645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:15.522598 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:15.522562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:20.243415 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:20.243385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:20.343580 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:20.343549 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:20.443735 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:20.443696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:21.068091 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:21.068053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:21.131583 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:21.131540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:22.947233 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:22.947187 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:41.857701 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:41.857617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:49.485734 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:49.485699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:49.586671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:49.586626 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:57.700796 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:57.700757 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:18:57.834285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:18:57.834256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:04.657094 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.657056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:04.665900 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.665864 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bb5f4cb56-mggw9"] Jul 02 23:19:04.669253 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.669233 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:04.671538 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.671506 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 23:19:04.671538 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.671528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mms8x\"" Jul 02 23:19:04.671682 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.671511 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 23:19:04.680586 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.680563 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb5f4cb56-mggw9"] Jul 02 23:19:04.754109 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.754078 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:04.771291 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.771268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert\") pod \"maas-controller-bb5f4cb56-mggw9\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:04.771410 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.771390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5gk6\" (UniqueName: \"kubernetes.io/projected/4175cf10-3fc8-4979-81a2-d97571ba0f00-kube-api-access-s5gk6\") pod \"maas-controller-bb5f4cb56-mggw9\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:04.812476 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.812446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:04.872591 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.872554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5gk6\" (UniqueName: \"kubernetes.io/projected/4175cf10-3fc8-4979-81a2-d97571ba0f00-kube-api-access-s5gk6\") pod \"maas-controller-bb5f4cb56-mggw9\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:04.872777 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.872596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert\") pod \"maas-controller-bb5f4cb56-mggw9\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:04.872777 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:19:04.872709 2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 02 23:19:04.872873 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:19:04.872783 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert podName:4175cf10-3fc8-4979-81a2-d97571ba0f00 nodeName:}" failed. No retries permitted until 2026-07-02 23:19:05.372762263 +0000 UTC m=+472.851975005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert") pod "maas-controller-bb5f4cb56-mggw9" (UID: "4175cf10-3fc8-4979-81a2-d97571ba0f00") : secret "maas-controller-webhook-cert" not found Jul 02 23:19:04.881739 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.881716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5gk6\" (UniqueName: \"kubernetes.io/projected/4175cf10-3fc8-4979-81a2-d97571ba0f00-kube-api-access-s5gk6\") pod \"maas-controller-bb5f4cb56-mggw9\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:04.950340 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:04.950308 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:05.376811 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:05.376736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert\") pod \"maas-controller-bb5f4cb56-mggw9\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:05.379149 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:05.379126 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert\") pod \"maas-controller-bb5f4cb56-mggw9\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:05.580050 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:05.580004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:05.710671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:05.710651 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bb5f4cb56-mggw9"] Jul 02 23:19:05.713319 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:19:05.713292 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4175cf10_3fc8_4979_81a2_d97571ba0f00.slice/crio-11ca4fdbf9de44c04ba230d4025bd024d2fc1fc4034caa2dc7f242273b01008a WatchSource:0}: Error finding container 11ca4fdbf9de44c04ba230d4025bd024d2fc1fc4034caa2dc7f242273b01008a: Status 404 returned error can't find the container with id 11ca4fdbf9de44c04ba230d4025bd024d2fc1fc4034caa2dc7f242273b01008a Jul 02 23:19:06.281046 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:06.281014 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" event={"ID":"4175cf10-3fc8-4979-81a2-d97571ba0f00","Type":"ContainerStarted","Data":"11ca4fdbf9de44c04ba230d4025bd024d2fc1fc4034caa2dc7f242273b01008a"} Jul 02 23:19:06.968068 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:19:06.968026 2578 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad9e4ac5a367c01827a1ce67119aea965257777632870df4c72cb821799935d6: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/opendatahub/maas-controller@sha256:ef362f70776db7df93220fc73f5dcc0991924a4ed200128b475a29a88ae8ca85" Jul 02 23:19:06.968430 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:19:06.968125 2578 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod maas-controller-bb5f4cb56-mggw9_opendatahub(4175cf10-3fc8-4979-81a2-d97571ba0f00): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad9e4ac5a367c01827a1ce67119aea965257777632870df4c72cb821799935d6: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError" Jul 02 23:19:06.968430 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:19:06.968155 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad9e4ac5a367c01827a1ce67119aea965257777632870df4c72cb821799935d6: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" podUID="4175cf10-3fc8-4979-81a2-d97571ba0f00" Jul 02 23:19:07.286170 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:19:07.286133 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/maas-controller@sha256:ef362f70776db7df93220fc73f5dcc0991924a4ed200128b475a29a88ae8ca85\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad9e4ac5a367c01827a1ce67119aea965257777632870df4c72cb821799935d6: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" podUID="4175cf10-3fc8-4979-81a2-d97571ba0f00" Jul 02 23:19:07.549597 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:07.549511 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:07.659601 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:07.659566 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:19.394919 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.394873 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb5f4cb56-mggw9"] Jul 02 23:19:19.525996 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.525974 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:19.611439 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.611407 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5gk6\" (UniqueName: \"kubernetes.io/projected/4175cf10-3fc8-4979-81a2-d97571ba0f00-kube-api-access-s5gk6\") pod \"4175cf10-3fc8-4979-81a2-d97571ba0f00\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " Jul 02 23:19:19.611587 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.611513 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert\") pod \"4175cf10-3fc8-4979-81a2-d97571ba0f00\" (UID: \"4175cf10-3fc8-4979-81a2-d97571ba0f00\") " Jul 02 23:19:19.613593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.613561 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4175cf10-3fc8-4979-81a2-d97571ba0f00-kube-api-access-s5gk6" (OuterVolumeSpecName: "kube-api-access-s5gk6") pod "4175cf10-3fc8-4979-81a2-d97571ba0f00" (UID: "4175cf10-3fc8-4979-81a2-d97571ba0f00"). InnerVolumeSpecName "kube-api-access-s5gk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:19:19.613593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.613558 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4175cf10-3fc8-4979-81a2-d97571ba0f00" (UID: "4175cf10-3fc8-4979-81a2-d97571ba0f00"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 23:19:19.712345 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.712315 2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4175cf10-3fc8-4979-81a2-d97571ba0f00-webhook-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:19:19.712345 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:19.712340 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5gk6\" (UniqueName: \"kubernetes.io/projected/4175cf10-3fc8-4979-81a2-d97571ba0f00-kube-api-access-s5gk6\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:19:20.345579 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:20.345549 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" Jul 02 23:19:20.345741 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:20.345588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bb5f4cb56-mggw9" event={"ID":"4175cf10-3fc8-4979-81a2-d97571ba0f00","Type":"ContainerDied","Data":"11ca4fdbf9de44c04ba230d4025bd024d2fc1fc4034caa2dc7f242273b01008a"} Jul 02 23:19:20.379986 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:20.379955 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bb5f4cb56-mggw9"] Jul 02 23:19:20.386513 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:20.386485 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bb5f4cb56-mggw9"] Jul 02 23:19:21.014634 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:21.014602 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4175cf10-3fc8-4979-81a2-d97571ba0f00" path="/var/lib/kubelet/pods/4175cf10-3fc8-4979-81a2-d97571ba0f00/volumes" Jul 02 23:19:39.003357 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:39.003321 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:39.532335 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:39.532290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:39.903467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:39.903349 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:40.007287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.007247 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:40.101210 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.101174 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-6vjfh"] Jul 02 23:19:40.103599 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.103570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:40.104258 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.104243 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.106326 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.106310 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 23:19:40.115753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.115729 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-6vjfh"] Jul 02 23:19:40.198760 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.198726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x968\" (UniqueName: \"kubernetes.io/projected/40658ecb-7f59-49dd-a2a1-7ad172b337de-kube-api-access-6x968\") pod \"payload-pre-processing-7964457696-6vjfh\" (UID: \"40658ecb-7f59-49dd-a2a1-7ad172b337de\") " pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.198950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.198777 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40658ecb-7f59-49dd-a2a1-7ad172b337de-plugins-config-volume\") pod \"payload-pre-processing-7964457696-6vjfh\" (UID: \"40658ecb-7f59-49dd-a2a1-7ad172b337de\") " pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.299389 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.299352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x968\" (UniqueName: \"kubernetes.io/projected/40658ecb-7f59-49dd-a2a1-7ad172b337de-kube-api-access-6x968\") pod \"payload-pre-processing-7964457696-6vjfh\" (UID: \"40658ecb-7f59-49dd-a2a1-7ad172b337de\") " pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.299580 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.299403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40658ecb-7f59-49dd-a2a1-7ad172b337de-plugins-config-volume\") pod \"payload-pre-processing-7964457696-6vjfh\" (UID: \"40658ecb-7f59-49dd-a2a1-7ad172b337de\") " pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.300061 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.300041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40658ecb-7f59-49dd-a2a1-7ad172b337de-plugins-config-volume\") pod \"payload-pre-processing-7964457696-6vjfh\" (UID: \"40658ecb-7f59-49dd-a2a1-7ad172b337de\") " pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.306914 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.306866 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x968\" (UniqueName: \"kubernetes.io/projected/40658ecb-7f59-49dd-a2a1-7ad172b337de-kube-api-access-6x968\") pod \"payload-pre-processing-7964457696-6vjfh\" (UID: \"40658ecb-7f59-49dd-a2a1-7ad172b337de\") " pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.415262 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.415230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:40.550248 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:40.550224 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-6vjfh"] Jul 02 23:19:40.552913 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:19:40.552859 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40658ecb_7f59_49dd_a2a1_7ad172b337de.slice/crio-918b395acc45b699b0512a7f9c6a48a25421ea09b3220faea66a0188e2ff7719 WatchSource:0}: Error finding container 918b395acc45b699b0512a7f9c6a48a25421ea09b3220faea66a0188e2ff7719: Status 404 returned error can't find the container with id 918b395acc45b699b0512a7f9c6a48a25421ea09b3220faea66a0188e2ff7719 Jul 02 23:19:41.145461 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:41.145430 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:41.442565 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:41.442532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" event={"ID":"40658ecb-7f59-49dd-a2a1-7ad172b337de","Type":"ContainerStarted","Data":"918b395acc45b699b0512a7f9c6a48a25421ea09b3220faea66a0188e2ff7719"} Jul 02 23:19:42.448660 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:42.448618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" event={"ID":"40658ecb-7f59-49dd-a2a1-7ad172b337de","Type":"ContainerStarted","Data":"67ec7a4614a4e172fc08537d53ad84fd5256d25cc459ba3498094527a401d78d"} Jul 02 23:19:42.449148 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:42.448744 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:19:42.465895 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:42.465838 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" podStartSLOduration=1.3421391950000001 podStartE2EDuration="2.465826379s" totalImagesPullingTime="1.123687184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:19:42.463628579 +0000 UTC m=+509.942841343" watchObservedRunningTime="2026-07-02 23:19:42.465826379 +0000 UTC m=+509.945039167" Jul 02 23:19:49.527507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:49.527472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:49.627762 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:49.627729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:19:53.455076 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:19:53.455042 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-6vjfh" Jul 02 23:20:00.296109 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.296077 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28"] Jul 02 23:20:00.299467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.299451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.302389 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.302361 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 23:20:00.302389 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.302385 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 23:20:00.302591 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.302401 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 23:20:00.302591 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.302367 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8wqs2\"" Jul 02 23:20:00.307984 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.307964 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28"] Jul 02 23:20:00.322598 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.322567 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:20:00.378803 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.378772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.378974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.378811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4267b34-4373-4daf-b939-bba1cb0c0ef4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.378974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.378838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.378974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.378931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.378974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.378953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg4c2\" (UniqueName: \"kubernetes.io/projected/d4267b34-4373-4daf-b939-bba1cb0c0ef4-kube-api-access-qg4c2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.379124 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.378982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480007 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.479972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480186 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480186 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg4c2\" (UniqueName: \"kubernetes.io/projected/d4267b34-4373-4daf-b939-bba1cb0c0ef4-kube-api-access-qg4c2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480186 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480186 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480186 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4267b34-4373-4daf-b939-bba1cb0c0ef4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480453 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480364 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480501 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480461 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.480546 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.480527 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.482449 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.482432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d4267b34-4373-4daf-b939-bba1cb0c0ef4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.482751 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.482736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4267b34-4373-4daf-b939-bba1cb0c0ef4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.487460 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.487441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg4c2\" (UniqueName: \"kubernetes.io/projected/d4267b34-4373-4daf-b939-bba1cb0c0ef4-kube-api-access-qg4c2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28\" (UID: \"d4267b34-4373-4daf-b939-bba1cb0c0ef4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.610622 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.610534 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:00.749358 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:00.749323 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28"] Jul 02 23:20:00.749495 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:20:00.749418 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4267b34_4373_4daf_b939_bba1cb0c0ef4.slice/crio-4ec4286650c545cf9d7e65a80d213a3d4e36e4e408eea9164bd091b1335174f5 WatchSource:0}: Error finding container 4ec4286650c545cf9d7e65a80d213a3d4e36e4e408eea9164bd091b1335174f5: Status 404 returned error can't find the container with id 4ec4286650c545cf9d7e65a80d213a3d4e36e4e408eea9164bd091b1335174f5 Jul 02 23:20:01.540744 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:01.540707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" event={"ID":"d4267b34-4373-4daf-b939-bba1cb0c0ef4","Type":"ContainerStarted","Data":"4ec4286650c545cf9d7e65a80d213a3d4e36e4e408eea9164bd091b1335174f5"} Jul 02 23:20:02.547344 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:02.547312 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" event={"ID":"d4267b34-4373-4daf-b939-bba1cb0c0ef4","Type":"ContainerStarted","Data":"fd4f8b3e78a0898853229922a329b0881c63f4ddf521c3289b52dfb687ae60a9"} Jul 02 23:20:02.565754 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:02.565705 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" podStartSLOduration=1.43021614 podStartE2EDuration="2.565689343s" totalImagesPullingTime="1.135473203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:02.563372713 +0000 UTC m=+530.042585472" watchObservedRunningTime="2026-07-02 23:20:02.565689343 +0000 UTC m=+530.044902104" Jul 02 23:20:10.610861 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:10.610779 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:10.610861 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:10.610837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:10.623652 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:10.623624 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:11.601815 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:11.601787 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28" Jul 02 23:20:24.122045 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:24.122007 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:20:45.838567 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:45.838525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:20:57.379459 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.379427 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw"] Jul 02 23:20:57.383212 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.383189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.385726 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.385704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 02 23:20:57.392202 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.392177 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw"] Jul 02 23:20:57.409754 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.409724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:20:57.510363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.510332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bcb09e-3532-46eb-86ad-94d493f16e55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.510558 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.510378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.510558 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.510486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59bt\" (UniqueName: \"kubernetes.io/projected/93bcb09e-3532-46eb-86ad-94d493f16e55-kube-api-access-r59bt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.510558 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.510544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.510721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.510572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.510721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.510611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611324 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r59bt\" (UniqueName: \"kubernetes.io/projected/93bcb09e-3532-46eb-86ad-94d493f16e55-kube-api-access-r59bt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bcb09e-3532-46eb-86ad-94d493f16e55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611979 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.611979 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.611928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.613791 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.613772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93bcb09e-3532-46eb-86ad-94d493f16e55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.613930 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.613914 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93bcb09e-3532-46eb-86ad-94d493f16e55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.619440 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.619404 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59bt\" (UniqueName: \"kubernetes.io/projected/93bcb09e-3532-46eb-86ad-94d493f16e55-kube-api-access-r59bt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw\" (UID: \"93bcb09e-3532-46eb-86ad-94d493f16e55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.694564 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.694529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:20:57.835610 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:57.835582 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw"] Jul 02 23:20:57.837832 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:20:57.837800 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bcb09e_3532_46eb_86ad_94d493f16e55.slice/crio-deccd9f446e5c7ff9d18b31fd1aaa9184e55f946565ac6d0d701db5370bbda70 WatchSource:0}: Error finding container deccd9f446e5c7ff9d18b31fd1aaa9184e55f946565ac6d0d701db5370bbda70: Status 404 returned error can't find the container with id deccd9f446e5c7ff9d18b31fd1aaa9184e55f946565ac6d0d701db5370bbda70 Jul 02 23:20:58.812756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:58.812719 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" event={"ID":"93bcb09e-3532-46eb-86ad-94d493f16e55","Type":"ContainerStarted","Data":"710aad27cba12e6daba6184e010866e4d19f17f5af898f976d5b205fdb1490a4"} Jul 02 23:20:58.813180 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:58.812774 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" event={"ID":"93bcb09e-3532-46eb-86ad-94d493f16e55","Type":"ContainerStarted","Data":"deccd9f446e5c7ff9d18b31fd1aaa9184e55f946565ac6d0d701db5370bbda70"} Jul 02 23:20:58.832106 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:20:58.832059 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" podStartSLOduration=1.664471477 podStartE2EDuration="1.832042673s" totalImagesPullingTime="167.571196ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:58.83010939 +0000 UTC m=+586.309322155" watchObservedRunningTime="2026-07-02 23:20:58.832042673 +0000 UTC m=+586.311255445" Jul 02 23:21:03.121798 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:21:03.121768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:21:07.317274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:21:07.312948 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:21:07.694781 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:21:07.694749 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:21:07.695160 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:21:07.694832 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:21:07.707261 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:21:07.707235 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:21:07.866260 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:21:07.866230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw" Jul 02 23:21:51.306168 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:21:51.306094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:11.636654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:11.636617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:11.734609 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:11.734574 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:11.967643 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:11.967609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:12.021757 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:12.021730 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:14.769930 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:14.769876 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:14.872624 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:14.872579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:15.963877 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:15.963840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:22:16.059769 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:22:16.059729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:23:26.755159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:23:26.755115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:23:28.241869 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:23:28.241837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:23:50.606632 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:23:50.606597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:01.883734 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:01.883695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:01.973372 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:01.973339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:02.081486 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:02.081442 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:07.894459 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:07.894424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:07.998951 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:07.998917 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:08.104865 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:08.104829 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:08.246378 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:08.246344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:14.062764 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:14.062733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:14.123721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:14.123695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:49.195718 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:49.195644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:24:49.296739 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:24:49.296709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:26:42.698157 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:26:42.698104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:26:43.886657 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:26:43.886622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:28:05.495086 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:05.495012 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm"] Jul 02 23:28:05.498068 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:05.495226 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" podUID="a57b9e82-b0a9-4b19-ac66-7733de022d4e" containerName="manager" containerID="cri-o://4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec" gracePeriod=10 Jul 02 23:28:08.438850 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.438822 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:28:08.590506 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.590413 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwp8n\" (UniqueName: \"kubernetes.io/projected/a57b9e82-b0a9-4b19-ac66-7733de022d4e-kube-api-access-zwp8n\") pod \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " Jul 02 23:28:08.590506 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.590464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57b9e82-b0a9-4b19-ac66-7733de022d4e-extensions-socket-volume\") pod \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\" (UID: \"a57b9e82-b0a9-4b19-ac66-7733de022d4e\") " Jul 02 23:28:08.590859 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.590828 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a57b9e82-b0a9-4b19-ac66-7733de022d4e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a57b9e82-b0a9-4b19-ac66-7733de022d4e" (UID: "a57b9e82-b0a9-4b19-ac66-7733de022d4e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:28:08.592720 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.592700 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57b9e82-b0a9-4b19-ac66-7733de022d4e-kube-api-access-zwp8n" (OuterVolumeSpecName: "kube-api-access-zwp8n") pod "a57b9e82-b0a9-4b19-ac66-7733de022d4e" (UID: "a57b9e82-b0a9-4b19-ac66-7733de022d4e"). InnerVolumeSpecName "kube-api-access-zwp8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:28:08.691540 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.691504 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwp8n\" (UniqueName: \"kubernetes.io/projected/a57b9e82-b0a9-4b19-ac66-7733de022d4e-kube-api-access-zwp8n\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:28:08.691540 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.691537 2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a57b9e82-b0a9-4b19-ac66-7733de022d4e-extensions-socket-volume\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:28:08.905842 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.905756 2578 generic.go:356] "Generic (PLEG): container finished" podID="a57b9e82-b0a9-4b19-ac66-7733de022d4e" containerID="4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec" exitCode=0 Jul 02 23:28:08.905842 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.905813 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" Jul 02 23:28:08.906065 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.905817 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" event={"ID":"a57b9e82-b0a9-4b19-ac66-7733de022d4e","Type":"ContainerDied","Data":"4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec"} Jul 02 23:28:08.906065 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.905948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm" event={"ID":"a57b9e82-b0a9-4b19-ac66-7733de022d4e","Type":"ContainerDied","Data":"d74baf9a6bbc1312a81f4776be223119814f97b1b30a39799ffe67470b52b89f"} Jul 02 23:28:08.906065 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.905971 2578 scope.go:117] "RemoveContainer" containerID="4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec" Jul 02 23:28:08.915620 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.915604 2578 scope.go:117] "RemoveContainer" containerID="4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec" Jul 02 23:28:08.915865 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:28:08.915849 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec\": container with ID starting with 4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec not found: ID does not exist" containerID="4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec" Jul 02 23:28:08.915930 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.915876 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec"} err="failed to get container status \"4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec\": rpc error: code = NotFound desc = could not find container \"4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec\": container with ID starting with 4c07a0a03839f926c2c01b2997d6196f3d1c700c95d04deac4815a53181ff1ec not found: ID does not exist" Jul 02 23:28:08.926865 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.926841 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm"] Jul 02 23:28:08.931046 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:08.931025 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hfxcm"] Jul 02 23:28:09.015529 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:09.015496 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57b9e82-b0a9-4b19-ac66-7733de022d4e" path="/var/lib/kubelet/pods/a57b9e82-b0a9-4b19-ac66-7733de022d4e/volumes" Jul 02 23:28:11.163688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:28:11.163648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:29:06.655205 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.655115 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp"] Jul 02 23:29:06.655686 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.655494 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57b9e82-b0a9-4b19-ac66-7733de022d4e" containerName="manager" Jul 02 23:29:06.655686 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.655504 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57b9e82-b0a9-4b19-ac66-7733de022d4e" containerName="manager" Jul 02 23:29:06.655686 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.655569 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57b9e82-b0a9-4b19-ac66-7733de022d4e" containerName="manager" Jul 02 23:29:06.658808 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.658791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:06.662165 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.662121 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rh4ws\"" Jul 02 23:29:06.662165 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.662125 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 23:29:06.662361 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.662305 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 23:29:06.669690 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.669669 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp"] Jul 02 23:29:06.738936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.738903 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ae8403-2fbb-4e7d-b83c-1f8539b0a809-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k5twp\" (UID: \"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:06.739116 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.739018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mt6c\" (UniqueName: \"kubernetes.io/projected/c3ae8403-2fbb-4e7d-b83c-1f8539b0a809-kube-api-access-4mt6c\") pod \"kuadrant-operator-controller-manager-86878c769f-k5twp\" (UID: \"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:06.840469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.840423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ae8403-2fbb-4e7d-b83c-1f8539b0a809-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k5twp\" (UID: \"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:06.840624 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.840488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mt6c\" (UniqueName: \"kubernetes.io/projected/c3ae8403-2fbb-4e7d-b83c-1f8539b0a809-kube-api-access-4mt6c\") pod \"kuadrant-operator-controller-manager-86878c769f-k5twp\" (UID: \"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:06.840824 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.840804 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3ae8403-2fbb-4e7d-b83c-1f8539b0a809-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k5twp\" (UID: \"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:06.848841 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.848810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mt6c\" (UniqueName: \"kubernetes.io/projected/c3ae8403-2fbb-4e7d-b83c-1f8539b0a809-kube-api-access-4mt6c\") pod \"kuadrant-operator-controller-manager-86878c769f-k5twp\" (UID: \"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:06.969027 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:06.968998 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:07.116899 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:07.116846 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp"] Jul 02 23:29:07.120288 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:29:07.120262 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ae8403_2fbb_4e7d_b83c_1f8539b0a809.slice/crio-2acd448f54fb09455ea502c12f088b91b7e025ec2c3165d509e2f8ab6df1cd6e WatchSource:0}: Error finding container 2acd448f54fb09455ea502c12f088b91b7e025ec2c3165d509e2f8ab6df1cd6e: Status 404 returned error can't find the container with id 2acd448f54fb09455ea502c12f088b91b7e025ec2c3165d509e2f8ab6df1cd6e Jul 02 23:29:07.182680 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:07.182649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" event={"ID":"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809","Type":"ContainerStarted","Data":"2acd448f54fb09455ea502c12f088b91b7e025ec2c3165d509e2f8ab6df1cd6e"} Jul 02 23:29:08.189247 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:08.189198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" event={"ID":"c3ae8403-2fbb-4e7d-b83c-1f8539b0a809","Type":"ContainerStarted","Data":"f0897381033e39c1642d813246323ab42453e3dc2aca4c52a6e479f210ac551e"} Jul 02 23:29:08.189659 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:08.189287 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:08.212202 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:08.212154 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" podStartSLOduration=2.21214061 podStartE2EDuration="2.21214061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:29:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:29:08.210021603 +0000 UTC m=+1075.689234387" watchObservedRunningTime="2026-07-02 23:29:08.21214061 +0000 UTC m=+1075.691353439" Jul 02 23:29:19.206121 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:19.206090 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k5twp" Jul 02 23:29:44.740205 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:29:44.740169 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:34:52.924345 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:34:52.924305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:34:58.196580 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:34:58.196542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:06.514861 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:06.514788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:11.549375 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:11.549335 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:14.432777 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:14.432733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:14.534243 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:14.534208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:14.901952 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:14.901857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:20.511445 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.511406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:20.616237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.616190 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:20.700626 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.700593 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp"] Jul 02 23:35:20.704242 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.704217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.706390 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.706362 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cb663cc4-openshift-default-dockercfg-zmmg6\"" Jul 02 23:35:20.726540 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.726507 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp"] Jul 02 23:35:20.738496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.738467 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:20.807316 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-credential-socket\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807316 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807272 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-certs\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807316 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807289 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-data\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807316 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-podinfo\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-token\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-envoy\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-socket\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807555 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxkmx\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-kube-api-access-fxkmx\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.807654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.807611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c157f098-af14-457a-9eb6-ef8ac52c2c68-istiod-ca-cert\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.837458 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.837410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:20.909103 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-envoy\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909103 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909109 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-socket\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxkmx\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-kube-api-access-fxkmx\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c157f098-af14-457a-9eb6-ef8ac52c2c68-istiod-ca-cert\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-credential-socket\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-certs\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-data\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-podinfo\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909648 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-token\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909648 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909572 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-socket\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909648 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-certs\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909809 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909710 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-data\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.909941 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.909908 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-credential-socket\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.910179 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.910157 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c157f098-af14-457a-9eb6-ef8ac52c2c68-istiod-ca-cert\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.911499 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.911483 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-envoy\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.911875 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.911857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-podinfo\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.917086 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.917063 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-token\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:20.918115 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:20.918097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxkmx\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-kube-api-access-fxkmx\") pod \"e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:21.015567 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:21.015529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:21.163189 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:21.163164 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp"] Jul 02 23:35:21.165696 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:35:21.165669 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc157f098_af14_457a_9eb6_ef8ac52c2c68.slice/crio-093ab588548ded97e1f8994c34a8e13ed44cb020aa6c2f55052fb78fa51fa347 WatchSource:0}: Error finding container 093ab588548ded97e1f8994c34a8e13ed44cb020aa6c2f55052fb78fa51fa347: Status 404 returned error can't find the container with id 093ab588548ded97e1f8994c34a8e13ed44cb020aa6c2f55052fb78fa51fa347 Jul 02 23:35:21.168364 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:21.168336 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:21.168436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:21.168397 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:21.168436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:21.168423 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:21.825699 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:21.825662 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:21.925812 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:21.925779 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:22.004575 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.004539 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" event={"ID":"c157f098-af14-457a-9eb6-ef8ac52c2c68","Type":"ContainerStarted","Data":"08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0"} Jul 02 23:35:22.004714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.004594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" event={"ID":"c157f098-af14-457a-9eb6-ef8ac52c2c68","Type":"ContainerStarted","Data":"093ab588548ded97e1f8994c34a8e13ed44cb020aa6c2f55052fb78fa51fa347"} Jul 02 23:35:22.016291 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.016269 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:22.021043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.021019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:22.031947 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.031902 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" podStartSLOduration=2.031868557 podStartE2EDuration="2.031868557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:22.029557172 +0000 UTC m=+1449.508769937" watchObservedRunningTime="2026-07-02 23:35:22.031868557 +0000 UTC m=+1449.511081375" Jul 02 23:35:22.038873 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.038840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:22.295717 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.295688 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:22.582782 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.582699 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:22.686216 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:22.686182 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:23.016182 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:23.016156 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:23.016578 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:23.016226 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:24.293063 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:24.293034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:27.007286 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:27.007241 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:27.186317 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:27.186284 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp"] Jul 02 23:35:27.186509 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:27.186453 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" podUID="c157f098-af14-457a-9eb6-ef8ac52c2c68" containerName="istio-proxy" containerID="cri-o://08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0" gracePeriod=30 Jul 02 23:35:27.212264 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:27.212234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:27.305921 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:27.305813 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:27.443699 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:27.443648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:28.667168 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:28.667139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:32.336218 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.336191 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:32.424823 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.424794 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-podinfo\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.424835 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-data\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.424853 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-socket\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425032 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.424911 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-credential-socket\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425148 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.425033 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-certs\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425148 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.425071 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-token\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425148 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.425116 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxkmx\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-kube-api-access-fxkmx\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425148 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.425144 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c157f098-af14-457a-9eb6-ef8ac52c2c68-istiod-ca-cert\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.425269 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.425175 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-envoy\") pod \"c157f098-af14-457a-9eb6-ef8ac52c2c68\" (UID: \"c157f098-af14-457a-9eb6-ef8ac52c2c68\") " Jul 02 23:35:32.428199 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.428148 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:32.428350 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.428263 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:32.428419 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.428363 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c157f098-af14-457a-9eb6-ef8ac52c2c68-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:35:32.428606 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.428574 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:32.428820 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.428791 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-data" (OuterVolumeSpecName: "istio-data") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:32.430419 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.430391 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-kube-api-access-fxkmx" (OuterVolumeSpecName: "kube-api-access-fxkmx") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "kube-api-access-fxkmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:32.430518 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.430426 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:32.430587 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.430573 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:35:32.430868 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.430848 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-token" (OuterVolumeSpecName: "istio-token") pod "c157f098-af14-457a-9eb6-ef8ac52c2c68" (UID: "c157f098-af14-457a-9eb6-ef8ac52c2c68"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:32.526895 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526857 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.526895 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526898 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.527107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526909 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.527107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526918 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.527107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526926 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.527107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526936 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c157f098-af14-457a-9eb6-ef8ac52c2c68-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.527107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526944 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.527107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526952 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxkmx\" (UniqueName: \"kubernetes.io/projected/c157f098-af14-457a-9eb6-ef8ac52c2c68-kube-api-access-fxkmx\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:32.527107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:32.526960 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c157f098-af14-457a-9eb6-ef8ac52c2c68-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:33.069200 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.069168 2578 generic.go:356] "Generic (PLEG): container finished" podID="c157f098-af14-457a-9eb6-ef8ac52c2c68" containerID="08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0" exitCode=0 Jul 02 23:35:33.069362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.069212 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" Jul 02 23:35:33.069362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.069248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" event={"ID":"c157f098-af14-457a-9eb6-ef8ac52c2c68","Type":"ContainerDied","Data":"08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0"} Jul 02 23:35:33.069362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.069289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp" event={"ID":"c157f098-af14-457a-9eb6-ef8ac52c2c68","Type":"ContainerDied","Data":"093ab588548ded97e1f8994c34a8e13ed44cb020aa6c2f55052fb78fa51fa347"} Jul 02 23:35:33.069362 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.069312 2578 scope.go:117] "RemoveContainer" containerID="08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0" Jul 02 23:35:33.080710 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.080684 2578 scope.go:117] "RemoveContainer" containerID="08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0" Jul 02 23:35:33.081142 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:35:33.081112 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0\": container with ID starting with 08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0 not found: ID does not exist" containerID="08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0" Jul 02 23:35:33.081251 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.081152 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0"} err="failed to get container status \"08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0\": rpc error: code = NotFound desc = could not find container \"08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0\": container with ID starting with 08e48f0f3486a9e218b845fb84e6b4c8f7ca0a43dd31001b0d717e3475f282e0 not found: ID does not exist" Jul 02 23:35:33.091453 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.091422 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp"] Jul 02 23:35:33.097163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.097137 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cb663cc4-openshift-default-7c768fb95f-b87lp"] Jul 02 23:35:33.128145 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.128112 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:33.231196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.231168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:33.302667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.302563 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m"] Jul 02 23:35:33.303216 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.303190 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c157f098-af14-457a-9eb6-ef8ac52c2c68" containerName="istio-proxy" Jul 02 23:35:33.303216 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.303216 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c157f098-af14-457a-9eb6-ef8ac52c2c68" containerName="istio-proxy" Jul 02 23:35:33.303367 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.303307 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c157f098-af14-457a-9eb6-ef8ac52c2c68" containerName="istio-proxy" Jul 02 23:35:33.306697 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.306679 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.309387 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.309367 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-37f19217-openshift-default-dockercfg-5sj8q\"" Jul 02 23:35:33.317298 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.317271 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m"] Jul 02 23:35:33.343005 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.342960 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:33.436630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-credential-socket\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.436630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436640 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-token\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.436850 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-certs\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.436850 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436779 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-data\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.436957 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436844 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-socket\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.436957 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-podinfo\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.436957 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-envoy\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.437049 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.436962 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd6lq\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-kube-api-access-bd6lq\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.437049 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.437037 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istiod-ca-cert\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.443189 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.443167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:33.537763 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.537725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-socket\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.537964 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.537784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-podinfo\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.537964 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.537806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-envoy\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.537964 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.537822 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd6lq\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-kube-api-access-bd6lq\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.537964 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.537847 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istiod-ca-cert\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.537964 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.537876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-credential-socket\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538215 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.537959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-token\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538215 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.538001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-certs\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538215 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.538064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-data\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538215 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.538190 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-socket\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538411 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.538237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-credential-socket\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538411 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.538389 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-data\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538521 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.538495 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-certs\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.538644 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.538626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istiod-ca-cert\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.540218 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.540197 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-envoy\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.540593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.540577 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-podinfo\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.566249 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.566171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-token\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.566404 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.566340 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd6lq\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-kube-api-access-bd6lq\") pod \"e2e-ait-37f19217-openshift-default-5d9676c979-jg67m\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.620472 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.620430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:33.764846 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.764819 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m"] Jul 02 23:35:33.767145 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:35:33.767115 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9e165b_afd0_4c39_b36c_2a194d75ac5c.slice/crio-8d05396ec1d644c51bee69c9f72d3f668680fcc9cd580592e8c86696e621f099 WatchSource:0}: Error finding container 8d05396ec1d644c51bee69c9f72d3f668680fcc9cd580592e8c86696e621f099: Status 404 returned error can't find the container with id 8d05396ec1d644c51bee69c9f72d3f668680fcc9cd580592e8c86696e621f099 Jul 02 23:35:33.769160 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.769128 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:33.769246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.769190 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:33.769246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:33.769224 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:34.076969 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.076849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" event={"ID":"ae9e165b-afd0-4c39-b36c-2a194d75ac5c","Type":"ContainerStarted","Data":"119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280"} Jul 02 23:35:34.076969 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.076933 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" event={"ID":"ae9e165b-afd0-4c39-b36c-2a194d75ac5c","Type":"ContainerStarted","Data":"8d05396ec1d644c51bee69c9f72d3f668680fcc9cd580592e8c86696e621f099"} Jul 02 23:35:34.097941 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.097833 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" podStartSLOduration=1.097812008 podStartE2EDuration="1.097812008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:34.096836586 +0000 UTC m=+1461.576049349" watchObservedRunningTime="2026-07-02 23:35:34.097812008 +0000 UTC m=+1461.577024770" Jul 02 23:35:34.455413 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.455367 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:34.544379 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.544343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:34.621427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.621375 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:34.642093 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.642067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:34.644471 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.644447 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:34.744624 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:34.744542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:35.015401 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:35.015325 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c157f098-af14-457a-9eb6-ef8ac52c2c68" path="/var/lib/kubelet/pods/c157f098-af14-457a-9eb6-ef8ac52c2c68/volumes" Jul 02 23:35:35.020220 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:35.020191 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:35.084022 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:35.083994 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:35.085079 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:35.085058 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:35.118796 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:35.118749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:36.872839 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:36.872809 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:39.555314 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:39.555264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:39.908095 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:39.908006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:42.971425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:42.971381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:45.137263 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.137227 2578 generic.go:356] "Generic (PLEG): container finished" podID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerID="119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280" exitCode=0 Jul 02 23:35:45.137725 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.137304 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" event={"ID":"ae9e165b-afd0-4c39-b36c-2a194d75ac5c","Type":"ContainerDied","Data":"119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280"} Jul 02 23:35:45.137901 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.137865 2578 scope.go:117] "RemoveContainer" containerID="119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280" Jul 02 23:35:45.139081 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.139052 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:45.139202 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.139118 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:45.139202 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.139148 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:45.637089 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.637056 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m"] Jul 02 23:35:45.658448 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.658418 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:45.762436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:45.762404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:46.150820 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:46.150786 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" event={"ID":"ae9e165b-afd0-4c39-b36c-2a194d75ac5c","Type":"ContainerStarted","Data":"b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c"} Jul 02 23:35:46.151266 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:46.150844 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerName="istio-proxy" containerID="cri-o://b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c" gracePeriod=30 Jul 02 23:35:47.564721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:47.564690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:50.084140 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:50.084100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:51.356546 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.356519 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:51.404938 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.404914 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:51.433142 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.433102 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:51.511427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511391 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-credential-socket\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511427 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511432 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-envoy\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511726 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511492 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istiod-ca-cert\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511726 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511609 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-certs\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511726 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511634 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-socket\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511726 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511688 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bd6lq\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-kube-api-access-bd6lq\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511978 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511744 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-token\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511978 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511812 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-data\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.511978 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511876 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-podinfo\") pod \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\" (UID: \"ae9e165b-afd0-4c39-b36c-2a194d75ac5c\") " Jul 02 23:35:51.512319 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.511808 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:51.512319 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.512059 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:51.512481 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.512382 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:35:51.512481 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.512365 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:51.513084 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.513013 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:51.514225 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.514202 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:35:51.514650 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.514630 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:51.514721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.514697 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-kube-api-access-bd6lq" (OuterVolumeSpecName: "kube-api-access-bd6lq") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "kube-api-access-bd6lq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:35:51.514795 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.514782 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae9e165b-afd0-4c39-b36c-2a194d75ac5c" (UID: "ae9e165b-afd0-4c39-b36c-2a194d75ac5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:35:51.553674 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.553640 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr"] Jul 02 23:35:51.554158 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.554140 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerName="istio-proxy" Jul 02 23:35:51.554158 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.554158 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerName="istio-proxy" Jul 02 23:35:51.554309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.554168 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerName="istio-proxy" Jul 02 23:35:51.554309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.554173 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerName="istio-proxy" Jul 02 23:35:51.554309 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.554238 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerName="istio-proxy" Jul 02 23:35:51.557554 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.557533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.559796 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.559774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-262e2828-openshift-default-dockercfg-m4cw7\"" Jul 02 23:35:51.576480 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.576453 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr"] Jul 02 23:35:51.593971 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.593936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:51.612974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.612943 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-socket\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.612974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.612975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istiod-ca-cert\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.612995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-certs\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-podinfo\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613152 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-data\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613353 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613199 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-envoy\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613353 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fjb\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-kube-api-access-j9fjb\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613353 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613316 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-token\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613513 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-credential-socket\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.613513 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613477 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613513 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613494 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613513 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613509 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bd6lq\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-kube-api-access-bd6lq\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613525 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613539 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613552 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613565 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613577 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.613681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.613591 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae9e165b-afd0-4c39-b36c-2a194d75ac5c-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:35:51.690095 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.690008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:51.714694 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.714658 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-socket\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.714843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.714694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istiod-ca-cert\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.714843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.714724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-certs\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.714843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.714770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-podinfo\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715044 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.714910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-data\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715044 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.714986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-envoy\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fjb\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-kube-api-access-j9fjb\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-token\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715156 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-credential-socket\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715313 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-certs\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715313 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-socket\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715313 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715261 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-data\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715480 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-credential-socket\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.715551 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.715528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istiod-ca-cert\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.717381 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.717355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-envoy\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.717478 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.717469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-podinfo\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.723122 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.723099 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fjb\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-kube-api-access-j9fjb\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.723446 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.723432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-token\") pod \"e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:51.877065 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:51.877027 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:52.012012 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.011988 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr"] Jul 02 23:35:52.014001 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:35:52.013972 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4adbe530_8e95_4e95_ba38_7f6dce4a9372.slice/crio-08d99125244b889a173e01183a2f3cd4f03de2448c8f276b55978800d02b12e0 WatchSource:0}: Error finding container 08d99125244b889a173e01183a2f3cd4f03de2448c8f276b55978800d02b12e0: Status 404 returned error can't find the container with id 08d99125244b889a173e01183a2f3cd4f03de2448c8f276b55978800d02b12e0 Jul 02 23:35:52.016025 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.015994 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:52.016122 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.016071 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:52.016122 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.016115 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:35:52.185803 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.185760 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" event={"ID":"4adbe530-8e95-4e95-ba38-7f6dce4a9372","Type":"ContainerStarted","Data":"e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d"} Jul 02 23:35:52.186002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.185835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" event={"ID":"4adbe530-8e95-4e95-ba38-7f6dce4a9372","Type":"ContainerStarted","Data":"08d99125244b889a173e01183a2f3cd4f03de2448c8f276b55978800d02b12e0"} Jul 02 23:35:52.187627 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.187600 2578 generic.go:356] "Generic (PLEG): container finished" podID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerID="b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c" exitCode=0 Jul 02 23:35:52.187751 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.187633 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" event={"ID":"ae9e165b-afd0-4c39-b36c-2a194d75ac5c","Type":"ContainerDied","Data":"b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c"} Jul 02 23:35:52.187751 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.187664 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" event={"ID":"ae9e165b-afd0-4c39-b36c-2a194d75ac5c","Type":"ContainerDied","Data":"8d05396ec1d644c51bee69c9f72d3f668680fcc9cd580592e8c86696e621f099"} Jul 02 23:35:52.187751 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.187673 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m" Jul 02 23:35:52.187751 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.187688 2578 scope.go:117] "RemoveContainer" containerID="b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c" Jul 02 23:35:52.196649 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.196626 2578 scope.go:117] "RemoveContainer" containerID="119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280" Jul 02 23:35:52.204198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.203997 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" podStartSLOduration=1.203980986 podStartE2EDuration="1.203980986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:52.202871633 +0000 UTC m=+1479.682084408" watchObservedRunningTime="2026-07-02 23:35:52.203980986 +0000 UTC m=+1479.683193749" Jul 02 23:35:52.207261 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.207244 2578 scope.go:117] "RemoveContainer" containerID="b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c" Jul 02 23:35:52.207822 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:35:52.207544 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c\": container with ID starting with b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c not found: ID does not exist" containerID="b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c" Jul 02 23:35:52.207822 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.207575 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c"} err="failed to get container status \"b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c\": rpc error: code = NotFound desc = could not find container \"b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c\": container with ID starting with b0229943d04ad06e9a915f739531f501ce3f4e4484991f1763483536dd772a4c not found: ID does not exist" Jul 02 23:35:52.207822 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.207596 2578 scope.go:117] "RemoveContainer" containerID="119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280" Jul 02 23:35:52.208223 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:35:52.208197 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280\": container with ID starting with 119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280 not found: ID does not exist" containerID="119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280" Jul 02 23:35:52.208290 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.208233 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280"} err="failed to get container status \"119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280\": rpc error: code = NotFound desc = could not find container \"119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280\": container with ID starting with 119e513ebb27bcf2970c07d0c192a61de662458af2b73744352bba8c392d7280 not found: ID does not exist" Jul 02 23:35:52.217162 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.217097 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m"] Jul 02 23:35:52.221577 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.221552 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-37f19217-openshift-default-5d9676c979-jg67m"] Jul 02 23:35:52.778231 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.778185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:52.874200 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.874168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:52.878019 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:52.878003 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:53.003347 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:53.003310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:53.016495 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:53.016467 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" path="/var/lib/kubelet/pods/ae9e165b-afd0-4c39-b36c-2a194d75ac5c/volumes" Jul 02 23:35:53.482714 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:53.482685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:53.635123 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:53.635095 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:53.883678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:53.883603 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:54.197797 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:54.197762 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:54.198550 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:54.198531 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:35:55.040262 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:55.040227 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:57.135099 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:57.135066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:57.287836 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:57.287793 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr"] Jul 02 23:35:57.288091 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:57.288041 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" podUID="4adbe530-8e95-4e95-ba38-7f6dce4a9372" containerName="istio-proxy" containerID="cri-o://e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d" gracePeriod=30 Jul 02 23:35:57.311938 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:57.311869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:57.414168 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:57.414093 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:57.481405 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:57.481374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:35:58.605729 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:35:58.605697 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:02.536424 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.536398 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:36:02.633431 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633323 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-token\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633431 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633402 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istiod-ca-cert\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633441 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-data\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633466 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-envoy\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633509 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-socket\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633547 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-certs\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633631 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9fjb\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-kube-api-access-j9fjb\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633952 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633716 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-podinfo\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633952 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633757 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-data" (OuterVolumeSpecName: "istio-data") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:02.633952 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633781 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-credential-socket\") pod \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\" (UID: \"4adbe530-8e95-4e95-ba38-7f6dce4a9372\") " Jul 02 23:36:02.633952 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633851 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:02.633952 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.633864 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:02.634225 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.634037 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:02.634225 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.634180 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:36:02.634225 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.634201 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.634225 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.634221 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.634363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.634235 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.634363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.634249 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.635872 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.635839 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:36:02.636039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.635934 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:36:02.636174 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.636155 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-token" (OuterVolumeSpecName: "istio-token") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:36:02.636279 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.636260 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-kube-api-access-j9fjb" (OuterVolumeSpecName: "kube-api-access-j9fjb") pod "4adbe530-8e95-4e95-ba38-7f6dce4a9372" (UID: "4adbe530-8e95-4e95-ba38-7f6dce4a9372"). InnerVolumeSpecName "kube-api-access-j9fjb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:36:02.735003 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.734948 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9fjb\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-kube-api-access-j9fjb\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.735003 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.734996 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.735003 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.735009 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.735251 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.735021 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:02.735251 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:02.735032 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4adbe530-8e95-4e95-ba38-7f6dce4a9372-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:36:03.245374 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.245343 2578 generic.go:356] "Generic (PLEG): container finished" podID="4adbe530-8e95-4e95-ba38-7f6dce4a9372" containerID="e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d" exitCode=0 Jul 02 23:36:03.245576 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.245396 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" Jul 02 23:36:03.245576 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.245433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" event={"ID":"4adbe530-8e95-4e95-ba38-7f6dce4a9372","Type":"ContainerDied","Data":"e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d"} Jul 02 23:36:03.245576 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.245488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr" event={"ID":"4adbe530-8e95-4e95-ba38-7f6dce4a9372","Type":"ContainerDied","Data":"08d99125244b889a173e01183a2f3cd4f03de2448c8f276b55978800d02b12e0"} Jul 02 23:36:03.245576 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.245509 2578 scope.go:117] "RemoveContainer" containerID="e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d" Jul 02 23:36:03.254830 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.254806 2578 scope.go:117] "RemoveContainer" containerID="e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d" Jul 02 23:36:03.255091 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:36:03.255074 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d\": container with ID starting with e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d not found: ID does not exist" containerID="e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d" Jul 02 23:36:03.255163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.255103 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d"} err="failed to get container status \"e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d\": rpc error: code = NotFound desc = could not find container \"e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d\": container with ID starting with e4ee70f86f19c6a6d8f81cc004e5dace47e7a4ea5cadd5ef02be7b4c95c13f0d not found: ID does not exist" Jul 02 23:36:03.262569 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.262548 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr"] Jul 02 23:36:03.268083 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.268058 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-262e2828-openshift-default-7c5ddc747f-hr6jr"] Jul 02 23:36:03.284314 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.284244 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:03.356112 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.356077 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:03.769365 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.769313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:03.912910 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:03.912864 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:04.063416 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:04.063335 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:05.015239 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:05.015200 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4adbe530-8e95-4e95-ba38-7f6dce4a9372" path="/var/lib/kubelet/pods/4adbe530-8e95-4e95-ba38-7f6dce4a9372/volumes" Jul 02 23:36:05.364670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:05.364588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:11.015282 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:11.015249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:11.120416 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:11.120379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:11.216034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:11.216005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:11.425325 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:11.425290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:11.769740 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:11.769656 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:37.746688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:37.746606 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:43.314605 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:43.314565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:43.373164 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:43.373121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:43.454330 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:43.454290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:43.555155 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:43.555118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:36:59.436233 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:36:59.436199 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:05.029327 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:05.029295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:05.136494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:05.136440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:05.233077 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:05.233034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:15.836979 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:15.836944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:16.601669 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:16.601632 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:16.702706 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:16.702670 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:22.350213 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:22.350179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:22.431704 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:22.431675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:22.514314 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:22.514281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:22.615098 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:22.615026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:23.423400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:23.423359 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:23.523289 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:23.523245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:23.623180 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:23.623143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:25.253424 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:25.253371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:30.918389 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:30.918355 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:31.016849 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:31.016819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:31.600374 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:31.600344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:37.387218 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:37.387180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:37.452295 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:37.452262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:37.637100 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:37.637067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:38.010434 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.010400 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc"] Jul 02 23:37:38.010808 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.010796 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4adbe530-8e95-4e95-ba38-7f6dce4a9372" containerName="istio-proxy" Jul 02 23:37:38.010851 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.010810 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4adbe530-8e95-4e95-ba38-7f6dce4a9372" containerName="istio-proxy" Jul 02 23:37:38.010903 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.010869 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4adbe530-8e95-4e95-ba38-7f6dce4a9372" containerName="istio-proxy" Jul 02 23:37:38.010941 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.010910 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9e165b-afd0-4c39-b36c-2a194d75ac5c" containerName="istio-proxy" Jul 02 23:37:38.014071 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.014047 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.017699 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.017588 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-180069e8-openshift-default-dockercfg-24w7h\"" Jul 02 23:37:38.037830 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.037789 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc"] Jul 02 23:37:38.042215 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.042161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:38.054530 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-socket\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-certs\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054611 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-credential-socket\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054637 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5pxg\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-kube-api-access-f5pxg\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054762 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054661 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-data\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054762 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istiod-ca-cert\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054822 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-envoy\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054822 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054798 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-token\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.054919 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.054825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-podinfo\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.155691 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-socket\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.155691 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155694 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-certs\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-credential-socket\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5pxg\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-kube-api-access-f5pxg\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155799 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-data\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istiod-ca-cert\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-envoy\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-token\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156002 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.155971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-podinfo\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156509 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.156152 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-socket\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156509 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.156236 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-data\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156509 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.156310 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-certs\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156509 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.156401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-credential-socket\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.156664 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.156563 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istiod-ca-cert\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.158403 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.158382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-envoy\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.158517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.158500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-podinfo\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.163898 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.163854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-token\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.164019 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.163986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5pxg\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-kube-api-access-f5pxg\") pod \"e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.326621 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.326529 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:38.373305 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.373163 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:38.475068 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.475043 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc"] Jul 02 23:37:38.477975 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:37:38.477930 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf4e09e_21f9_42fc_9893_cf57b214dd34.slice/crio-327c154c1fb92631f06e12459dd76566993397509696734de6ba58fc8581dee7 WatchSource:0}: Error finding container 327c154c1fb92631f06e12459dd76566993397509696734de6ba58fc8581dee7: Status 404 returned error can't find the container with id 327c154c1fb92631f06e12459dd76566993397509696734de6ba58fc8581dee7 Jul 02 23:37:38.480253 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.480223 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:37:38.480368 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.480288 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:37:38.480368 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.480319 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:37:38.711035 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.710994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" event={"ID":"bcf4e09e-21f9-42fc-9893-cf57b214dd34","Type":"ContainerStarted","Data":"2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af"} Jul 02 23:37:38.711239 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.711058 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" event={"ID":"bcf4e09e-21f9-42fc-9893-cf57b214dd34","Type":"ContainerStarted","Data":"327c154c1fb92631f06e12459dd76566993397509696734de6ba58fc8581dee7"} Jul 02 23:37:38.732436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:38.732377 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" podStartSLOduration=1.732360568 podStartE2EDuration="1.732360568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:37:38.729922075 +0000 UTC m=+1586.209134836" watchObservedRunningTime="2026-07-02 23:37:38.732360568 +0000 UTC m=+1586.211573402" Jul 02 23:37:39.327630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:39.327591 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:39.332816 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:39.332793 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:39.716748 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:39.716713 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:39.718654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:39.718630 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:40.534169 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:40.534136 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:40.585789 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:40.585747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:40.700950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:40.700901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:40.788286 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:40.788185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:40.899379 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:40.899333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:41.142628 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:41.142537 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:41.487325 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:41.487277 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:41.620518 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:41.620471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:45.187333 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:45.187298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:45.847445 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:45.847392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:45.945146 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:45.945110 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:46.293548 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:46.293501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:52.233394 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:52.233358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:52.333075 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:52.333044 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:52.663860 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:52.663782 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:53.009624 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.009582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:53.072264 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.072230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:53.790591 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.790559 2578 generic.go:356] "Generic (PLEG): container finished" podID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerID="2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af" exitCode=0 Jul 02 23:37:53.791051 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.790618 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" event={"ID":"bcf4e09e-21f9-42fc-9893-cf57b214dd34","Type":"ContainerDied","Data":"2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af"} Jul 02 23:37:53.791101 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.791089 2578 scope.go:117] "RemoveContainer" containerID="2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af" Jul 02 23:37:53.792130 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.792102 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:37:53.792240 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.792179 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:37:53.792240 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:53.792208 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:37:54.717451 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:54.717402 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:54.797622 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:54.797586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" event={"ID":"bcf4e09e-21f9-42fc-9893-cf57b214dd34","Type":"ContainerStarted","Data":"59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17"} Jul 02 23:37:55.326688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:55.326643 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:37:55.327959 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:55.327927 2578 patch_prober.go:28] interesting pod/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 23:37:55.328108 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:55.327997 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 23:37:56.327244 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:56.327203 2578 patch_prober.go:28] interesting pod/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 23:37:56.327730 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:56.327266 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 23:37:57.327061 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:57.327018 2578 patch_prober.go:28] interesting pod/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 23:37:57.327274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:57.327097 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 23:37:58.327109 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:58.327069 2578 patch_prober.go:28] interesting pod/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 02 23:37:58.327434 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:58.327393 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 02 23:37:58.755859 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:58.755820 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:58.855830 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:58.855798 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:58.987052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:58.987020 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc"] Jul 02 23:37:58.987283 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:58.987255 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" containerID="cri-o://59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17" gracePeriod=30 Jul 02 23:37:59.010351 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:59.010243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:59.234671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:59.234631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:59.358992 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:59.358870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:59.458034 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:59.457998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:37:59.577801 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:37:59.577768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:04.240793 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.240768 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:38:04.333222 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333131 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-certs\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333222 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333197 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-data\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333222 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333219 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-credential-socket\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333242 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istiod-ca-cert\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333294 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5pxg\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-kube-api-access-f5pxg\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333320 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-socket\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333344 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-envoy\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333388 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-token\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333507 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333415 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-podinfo\") pod \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\" (UID: \"bcf4e09e-21f9-42fc-9893-cf57b214dd34\") " Jul 02 23:38:04.333806 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333485 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:38:04.333806 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333667 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:38:04.333806 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333790 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.333997 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333812 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.333997 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333787 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:38:04.333997 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.333795 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:38:04.334376 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.334192 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-data" (OuterVolumeSpecName: "istio-data") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:38:04.335866 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.335836 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-kube-api-access-f5pxg" (OuterVolumeSpecName: "kube-api-access-f5pxg") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "kube-api-access-f5pxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:38:04.335866 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.335848 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:38:04.335866 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.335857 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-token" (OuterVolumeSpecName: "istio-token") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:38:04.335866 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.335836 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bcf4e09e-21f9-42fc-9893-cf57b214dd34" (UID: "bcf4e09e-21f9-42fc-9893-cf57b214dd34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:38:04.435031 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.434970 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.435031 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.435024 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.435031 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.435038 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.435285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.435049 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5pxg\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-kube-api-access-f5pxg\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.435285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.435062 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.435285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.435073 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.435285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.435083 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcf4e09e-21f9-42fc-9893-cf57b214dd34-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:38:04.848058 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.848020 2578 generic.go:356] "Generic (PLEG): container finished" podID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerID="59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17" exitCode=0 Jul 02 23:38:04.848274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.848077 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" Jul 02 23:38:04.848274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.848108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" event={"ID":"bcf4e09e-21f9-42fc-9893-cf57b214dd34","Type":"ContainerDied","Data":"59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17"} Jul 02 23:38:04.848274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.848168 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc" event={"ID":"bcf4e09e-21f9-42fc-9893-cf57b214dd34","Type":"ContainerDied","Data":"327c154c1fb92631f06e12459dd76566993397509696734de6ba58fc8581dee7"} Jul 02 23:38:04.848274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.848201 2578 scope.go:117] "RemoveContainer" containerID="59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17" Jul 02 23:38:04.859825 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.859800 2578 scope.go:117] "RemoveContainer" containerID="2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af" Jul 02 23:38:04.868099 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.868078 2578 scope.go:117] "RemoveContainer" containerID="59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17" Jul 02 23:38:04.868535 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:38:04.868386 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17\": container with ID starting with 59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17 not found: ID does not exist" containerID="59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17" Jul 02 23:38:04.868535 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.868426 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17"} err="failed to get container status \"59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17\": rpc error: code = NotFound desc = could not find container \"59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17\": container with ID starting with 59c33f0851e6f67fcdef10a3f94db5335158bff0e3fd0a3aee446c558d0fed17 not found: ID does not exist" Jul 02 23:38:04.868535 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.868461 2578 scope.go:117] "RemoveContainer" containerID="2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af" Jul 02 23:38:04.868929 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:38:04.868903 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af\": container with ID starting with 2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af not found: ID does not exist" containerID="2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af" Jul 02 23:38:04.869073 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.868936 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af"} err="failed to get container status \"2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af\": rpc error: code = NotFound desc = could not find container \"2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af\": container with ID starting with 2d0942dedbd469f7f2ea302dc5ee9831593c60536ec614892b86906fa52c71af not found: ID does not exist" Jul 02 23:38:04.870613 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.870593 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc"] Jul 02 23:38:04.875639 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:04.875618 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-180069e8-openshift-default-7978ffc77f-4fzgc"] Jul 02 23:38:05.015716 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:05.015682 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" path="/var/lib/kubelet/pods/bcf4e09e-21f9-42fc-9893-cf57b214dd34/volumes" Jul 02 23:38:05.312101 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:05.312050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:05.375639 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:05.375580 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:05.460914 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:05.460845 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:05.564414 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:05.564299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:05.678285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:05.678253 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:11.375654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:11.375618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:11.441400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:11.441358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:17.850639 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:17.850596 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:18.144005 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.143922 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq"] Jul 02 23:38:18.144349 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.144334 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" Jul 02 23:38:18.144401 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.144350 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" Jul 02 23:38:18.144436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.144428 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" Jul 02 23:38:18.144469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.144437 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" Jul 02 23:38:18.151005 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.149495 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.152420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.152396 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bebb6de2-openshift-default-dockercfg-5wwns\"" Jul 02 23:38:18.162158 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.162135 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq"] Jul 02 23:38:18.166555 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.166478 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:18.271639 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.271606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-token\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.271805 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.271686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istiod-ca-cert\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.271805 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.271718 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-credential-socket\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.271805 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.271737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh8qq\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-kube-api-access-zh8qq\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.271936 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.271916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-podinfo\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.271991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.271975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-data\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.272024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.272015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-envoy\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.272091 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.272076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-socket\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.272136 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.272121 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-certs\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.324464 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.324433 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:18.373066 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373034 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-podinfo\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373245 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-data\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373245 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373100 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-envoy\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373245 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-socket\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373245 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-certs\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373245 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373187 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-token\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373245 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373221 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istiod-ca-cert\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373563 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373249 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-credential-socket\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373563 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh8qq\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-kube-api-access-zh8qq\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373576 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-data\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-socket\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.373842 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373819 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-credential-socket\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.374107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.373854 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-certs\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.374107 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.374026 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istiod-ca-cert\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.375473 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.375452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-envoy\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.375695 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.375678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-podinfo\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.383564 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.383542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-token\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.384138 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.384095 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh8qq\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-kube-api-access-zh8qq\") pod \"e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.462461 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.462431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:18.602110 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.602077 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq"] Jul 02 23:38:18.604548 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:38:18.604518 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc011e94f_649c_4d4a_9c4d_b85ba8dff93f.slice/crio-eb87f8c8c32345e1792ef443eb2be503fc17290e55bc9d007283b0ec2030d67b WatchSource:0}: Error finding container eb87f8c8c32345e1792ef443eb2be503fc17290e55bc9d007283b0ec2030d67b: Status 404 returned error can't find the container with id eb87f8c8c32345e1792ef443eb2be503fc17290e55bc9d007283b0ec2030d67b Jul 02 23:38:18.606728 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.606689 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:38:18.606802 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.606784 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:38:18.606844 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.606831 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:38:18.915159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.915022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" event={"ID":"c011e94f-649c-4d4a-9c4d-b85ba8dff93f","Type":"ContainerStarted","Data":"5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625"} Jul 02 23:38:18.915159 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.915097 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" event={"ID":"c011e94f-649c-4d4a-9c4d-b85ba8dff93f","Type":"ContainerStarted","Data":"eb87f8c8c32345e1792ef443eb2be503fc17290e55bc9d007283b0ec2030d67b"} Jul 02 23:38:18.948211 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:18.948156 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" podStartSLOduration=0.94813381 podStartE2EDuration="948.13381ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:38:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:38:18.945018557 +0000 UTC m=+1626.424231316" watchObservedRunningTime="2026-07-02 23:38:18.94813381 +0000 UTC m=+1626.427346576" Jul 02 23:38:19.463380 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:19.463346 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:19.468110 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:19.468087 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:19.919909 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:19.919813 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:19.920794 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:19.920776 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:20.845310 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:20.845279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:20.930429 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:20.930392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:20.997679 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:20.997642 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:21.427405 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:21.427370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:21.527209 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:21.527175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:23.615131 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:23.615097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:23.717688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:23.717626 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:25.372361 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:25.372334 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:30.977534 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:30.977490 2578 generic.go:356] "Generic (PLEG): container finished" podID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerID="5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625" exitCode=0 Jul 02 23:38:30.978103 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:30.977586 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" event={"ID":"c011e94f-649c-4d4a-9c4d-b85ba8dff93f","Type":"ContainerDied","Data":"5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625"} Jul 02 23:38:30.978174 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:30.978120 2578 scope.go:117] "RemoveContainer" containerID="5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625" Jul 02 23:38:30.979181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:30.979153 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:38:30.979274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:30.979221 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:38:30.979274 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:30.979249 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:38:31.983960 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:31.983926 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" event={"ID":"c011e94f-649c-4d4a-9c4d-b85ba8dff93f","Type":"ContainerStarted","Data":"3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841"} Jul 02 23:38:32.463345 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:32.463309 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:32.464632 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:32.464608 2578 patch_prober.go:28] interesting pod/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 23:38:32.464711 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:32.464660 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 23:38:33.463128 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:33.463086 2578 patch_prober.go:28] interesting pod/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 23:38:33.463610 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:33.463149 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 23:38:34.463036 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:34.462996 2578 patch_prober.go:28] interesting pod/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 23:38:34.463244 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:34.463060 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 23:38:34.920525 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:34.920426 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:35.463829 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:35.463792 2578 patch_prober.go:28] interesting pod/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 02 23:38:35.464248 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:35.463857 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 02 23:38:36.467491 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:36.467459 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:36.468339 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:36.468319 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:38:38.615015 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:38.614975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:48.695736 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:48.695686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:48.799014 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:48.798982 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:57.905735 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:57.905697 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:58.400662 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:58.400629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:58.502003 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:58.501967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:38:58.663338 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:38:58.663232 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:04.041444 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:04.041402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:09.071609 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:09.071576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:45.528437 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:45.528343 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:45.933303 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:45.933271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:51.418484 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:51.418441 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:51.519250 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:51.519203 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:51.675532 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:51.675505 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq"] Jul 02 23:39:51.675762 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:51.675739 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" containerID="cri-o://3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841" gracePeriod=30 Jul 02 23:39:51.700513 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:51.700484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:51.930155 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:51.930055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:53.011544 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:53.011491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:53.109940 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:53.109909 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:53.207313 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:53.207283 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:53.903318 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:53.903276 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:54.002445 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:54.002415 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:54.104664 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:54.104635 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:55.504422 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:55.504388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:39:56.920227 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:56.920205 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:39:57.039597 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039517 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-socket\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039597 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039555 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh8qq\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-kube-api-access-zh8qq\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039597 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039578 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-token\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039597 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039594 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-envoy\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039653 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-data\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039700 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istiod-ca-cert\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039728 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-certs\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039764 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-credential-socket\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039796 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-podinfo\") pod \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\" (UID: \"c011e94f-649c-4d4a-9c4d-b85ba8dff93f\") " Jul 02 23:39:57.039950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.039913 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:39:57.040263 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.040127 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:39:57.040511 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.040470 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:39:57.040590 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.040510 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.040590 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.040529 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.040870 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.040835 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:39:57.041001 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.040982 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:39:57.042030 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.042009 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-kube-api-access-zh8qq" (OuterVolumeSpecName: "kube-api-access-zh8qq") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "kube-api-access-zh8qq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:39:57.042136 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.042103 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:39:57.042422 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.042401 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:39:57.042525 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.042503 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c011e94f-649c-4d4a-9c4d-b85ba8dff93f" (UID: "c011e94f-649c-4d4a-9c4d-b85ba8dff93f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:39:57.141761 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.141722 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.141761 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.141753 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.141761 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.141764 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.142023 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.141777 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.142023 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.141788 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh8qq\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-kube-api-access-zh8qq\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.142023 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.141800 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.142023 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.141811 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011e94f-649c-4d4a-9c4d-b85ba8dff93f-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:39:57.410408 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.410315 2578 generic.go:356] "Generic (PLEG): container finished" podID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerID="3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841" exitCode=0 Jul 02 23:39:57.410408 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.410367 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" Jul 02 23:39:57.410408 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.410363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" event={"ID":"c011e94f-649c-4d4a-9c4d-b85ba8dff93f","Type":"ContainerDied","Data":"3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841"} Jul 02 23:39:57.410636 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.410424 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq" event={"ID":"c011e94f-649c-4d4a-9c4d-b85ba8dff93f","Type":"ContainerDied","Data":"eb87f8c8c32345e1792ef443eb2be503fc17290e55bc9d007283b0ec2030d67b"} Jul 02 23:39:57.410636 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.410447 2578 scope.go:117] "RemoveContainer" containerID="3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841" Jul 02 23:39:57.420235 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.420220 2578 scope.go:117] "RemoveContainer" containerID="5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625" Jul 02 23:39:57.429048 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.429027 2578 scope.go:117] "RemoveContainer" containerID="3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841" Jul 02 23:39:57.429404 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:39:57.429370 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841\": container with ID starting with 3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841 not found: ID does not exist" containerID="3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841" Jul 02 23:39:57.429511 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.429412 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841"} err="failed to get container status \"3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841\": rpc error: code = NotFound desc = could not find container \"3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841\": container with ID starting with 3556c0a604134039373fc336ce15d513d1f02ce7adb1ce9a3a8eca567a962841 not found: ID does not exist" Jul 02 23:39:57.429511 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.429437 2578 scope.go:117] "RemoveContainer" containerID="5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625" Jul 02 23:39:57.429831 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:39:57.429811 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625\": container with ID starting with 5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625 not found: ID does not exist" containerID="5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625" Jul 02 23:39:57.429945 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.429836 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625"} err="failed to get container status \"5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625\": rpc error: code = NotFound desc = could not find container \"5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625\": container with ID starting with 5f9fcf9d09185b8e5cd5e4869fb6446cad69216a8b02ac0d253a78cc330fa625 not found: ID does not exist" Jul 02 23:39:57.431829 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.431806 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq"] Jul 02 23:39:57.433534 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:57.433514 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bebb6de2-openshift-default-687f9968c9-69hvq"] Jul 02 23:39:59.014941 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:39:59.014909 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" path="/var/lib/kubelet/pods/c011e94f-649c-4d4a-9c4d-b85ba8dff93f/volumes" Jul 02 23:40:01.190414 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:01.190378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:01.290234 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:01.290207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:01.487374 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:01.487273 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:01.879718 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:01.879629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:07.677616 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:07.677584 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:07.738581 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:07.738548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:07.803343 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:07.803308 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:07.904678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:07.904646 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:18.407255 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:18.407218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:18.760749 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:18.760708 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:39.729932 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:39.729892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:45.362455 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:45.362404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:45.423253 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:45.423223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:45.708586 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:45.708542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:46.000653 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.000568 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8"] Jul 02 23:40:46.001150 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.001128 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" Jul 02 23:40:46.001150 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.001151 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" Jul 02 23:40:46.001326 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.001174 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" Jul 02 23:40:46.001326 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.001183 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" Jul 02 23:40:46.001326 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.001196 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" Jul 02 23:40:46.001326 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.001203 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcf4e09e-21f9-42fc-9893-cf57b214dd34" containerName="istio-proxy" Jul 02 23:40:46.001556 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.001327 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" Jul 02 23:40:46.004420 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.004398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.006763 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.006742 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d73038-openshift-default-dockercfg-q289q\"" Jul 02 23:40:46.017671 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.017257 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8"] Jul 02 23:40:46.023432 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.023407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:46.107210 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-credential-socket\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107210 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107207 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-envoy\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-socket\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ptck\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-kube-api-access-8ptck\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d453fab7-b784-4e20-9498-8b6504449700-istio-podinfo\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-data\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107626 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d453fab7-b784-4e20-9498-8b6504449700-istiod-ca-cert\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107626 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107537 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-istio-token\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.107626 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.107586 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-certs\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.191988 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.191898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:46.208100 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208067 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d453fab7-b784-4e20-9498-8b6504449700-istio-podinfo\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208100 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-data\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d453fab7-b784-4e20-9498-8b6504449700-istiod-ca-cert\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208154 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-istio-token\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-certs\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208210 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-credential-socket\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-envoy\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-socket\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208328 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ptck\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-kube-api-access-8ptck\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-data\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208644 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-certs\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208838 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-credential-socket\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.208924 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.208873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-socket\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.209039 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.209018 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d453fab7-b784-4e20-9498-8b6504449700-istiod-ca-cert\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.210740 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.210711 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-envoy\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.210873 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.210857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d453fab7-b784-4e20-9498-8b6504449700-istio-podinfo\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.221854 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.221821 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-istio-token\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.222075 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.222046 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ptck\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-kube-api-access-8ptck\") pod \"e2e-inf-a-d73038-openshift-default-c76df9-z84b8\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.315290 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.315203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:46.467517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.467491 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8"] Jul 02 23:40:46.470091 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:40:46.470059 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd453fab7_b784_4e20_9498_8b6504449700.slice/crio-a53e11a0d00064e15ad5604318dc81221ac1d5fc4d7126f7bf7656a8d38a3483 WatchSource:0}: Error finding container a53e11a0d00064e15ad5604318dc81221ac1d5fc4d7126f7bf7656a8d38a3483: Status 404 returned error can't find the container with id a53e11a0d00064e15ad5604318dc81221ac1d5fc4d7126f7bf7656a8d38a3483 Jul 02 23:40:46.472163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.472132 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:40:46.472265 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.472209 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:40:46.472265 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.472253 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:40:46.649111 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.649011 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" event={"ID":"d453fab7-b784-4e20-9498-8b6504449700","Type":"ContainerStarted","Data":"40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8"} Jul 02 23:40:46.649111 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.649068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" event={"ID":"d453fab7-b784-4e20-9498-8b6504449700","Type":"ContainerStarted","Data":"a53e11a0d00064e15ad5604318dc81221ac1d5fc4d7126f7bf7656a8d38a3483"} Jul 02 23:40:46.668508 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:46.668441 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podStartSLOduration=1.668425562 podStartE2EDuration="1.668425562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:40:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:40:46.667264318 +0000 UTC m=+1774.146477082" watchObservedRunningTime="2026-07-02 23:40:46.668425562 +0000 UTC m=+1774.147638324" Jul 02 23:40:47.316193 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:47.316162 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:47.321134 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:47.321110 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:47.655483 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:47.655406 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:47.656483 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:47.656463 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:40:48.594278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:48.594236 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:48.691317 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:48.691287 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:48.830228 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:48.830197 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:49.072833 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:49.072798 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:49.478823 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:49.478784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:49.579178 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:49.579146 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:53.111702 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.111671 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:53.424779 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.424750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:53.702696 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.702605 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5"] Jul 02 23:40:53.703335 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.703300 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c011e94f-649c-4d4a-9c4d-b85ba8dff93f" containerName="istio-proxy" Jul 02 23:40:53.707150 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.707132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.709563 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.709541 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8c4f9c-openshift-default-dockercfg-4crfj\"" Jul 02 23:40:53.716782 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.716757 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5"] Jul 02 23:40:53.735239 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.735194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:53.887300 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-envoy\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887300 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887297 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-certs\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istiod-ca-cert\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-token\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887398 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-podinfo\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2dm5\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-kube-api-access-w2dm5\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887517 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887466 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-data\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887675 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-credential-socket\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.887675 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.887638 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-socket\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-credential-socket\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988158 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-socket\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-envoy\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988197 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-certs\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988539 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988212 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istiod-ca-cert\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988539 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988237 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-token\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988539 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988264 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-podinfo\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988539 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2dm5\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-kube-api-access-w2dm5\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988539 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-data\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988730 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988553 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-socket\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988784 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988759 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-certs\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988835 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988785 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-credential-socket\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.988914 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.988860 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-data\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.989200 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.989180 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istiod-ca-cert\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.990812 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.990794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-envoy\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.991053 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.991032 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-podinfo\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.996447 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.996413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-token\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:53.996676 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:53.996646 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2dm5\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-kube-api-access-w2dm5\") pod \"e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:54.020055 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.020018 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:54.033410 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.033380 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:54.166691 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.166668 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5"] Jul 02 23:40:54.169658 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:40:54.169623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e5f19c6_9eec_4155_8ecd_c3bb178bfba7.slice/crio-7013d3ab65bad6bacc0acf17ea925ba293f6dc90184eac4d9584af2b3c13becc WatchSource:0}: Error finding container 7013d3ab65bad6bacc0acf17ea925ba293f6dc90184eac4d9584af2b3c13becc: Status 404 returned error can't find the container with id 7013d3ab65bad6bacc0acf17ea925ba293f6dc90184eac4d9584af2b3c13becc Jul 02 23:40:54.172195 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.172163 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:40:54.172284 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.172229 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:40:54.172284 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.172259 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:40:54.693429 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.693396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" event={"ID":"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7","Type":"ContainerStarted","Data":"c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa"} Jul 02 23:40:54.693617 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.693455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" event={"ID":"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7","Type":"ContainerStarted","Data":"7013d3ab65bad6bacc0acf17ea925ba293f6dc90184eac4d9584af2b3c13becc"} Jul 02 23:40:54.712949 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:54.712841 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" podStartSLOduration=1.712819509 podStartE2EDuration="1.712819509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:40:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:40:54.712108543 +0000 UTC m=+1782.191321306" watchObservedRunningTime="2026-07-02 23:40:54.712819509 +0000 UTC m=+1782.192032273" Jul 02 23:40:55.021170 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:55.021085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:55.026310 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:55.026283 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:55.698545 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:55.698514 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:55.699510 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:55.699492 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:40:56.647522 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:56.647463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:56.729285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:56.729254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:56.790178 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:56.790145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:57.059684 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:57.059650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:57.209562 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:57.209532 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:40:57.309807 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:40:57.309726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:01.141478 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:01.141427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:02.657268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.657162 2578 patch_prober.go:28] interesting pod/e2e-inf-a-d73038-openshift-default-c76df9-z84b8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 23:41:02.657268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.657237 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 23:41:02.745240 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.745199 2578 generic.go:356] "Generic (PLEG): container finished" podID="d453fab7-b784-4e20-9498-8b6504449700" containerID="40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8" exitCode=0 Jul 02 23:41:02.745457 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.745276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" event={"ID":"d453fab7-b784-4e20-9498-8b6504449700","Type":"ContainerDied","Data":"40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8"} Jul 02 23:41:02.745785 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.745767 2578 scope.go:117] "RemoveContainer" containerID="40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8" Jul 02 23:41:02.747024 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.746988 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:41:02.747101 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.747074 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:41:02.747165 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:02.747121 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:41:03.760848 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:03.760643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" event={"ID":"d453fab7-b784-4e20-9498-8b6504449700","Type":"ContainerStarted","Data":"46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf"} Jul 02 23:41:04.316031 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:04.315989 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:41:04.316285 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:04.316261 2578 patch_prober.go:28] interesting pod/e2e-inf-a-d73038-openshift-default-c76df9-z84b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 23:41:04.316374 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:04.316317 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 23:41:05.315964 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:05.315928 2578 patch_prober.go:28] interesting pod/e2e-inf-a-d73038-openshift-default-c76df9-z84b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 23:41:05.316361 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:05.315982 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 23:41:06.316218 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:06.316194 2578 patch_prober.go:28] interesting pod/e2e-inf-a-d73038-openshift-default-c76df9-z84b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 23:41:06.316616 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:06.316256 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 23:41:07.121910 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:07.118407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:07.316062 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:07.316017 2578 patch_prober.go:28] interesting pod/e2e-inf-a-d73038-openshift-default-c76df9-z84b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body= Jul 02 23:41:07.316241 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:07.316089 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" Jul 02 23:41:08.320631 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:08.320599 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:41:08.321110 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:08.321020 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:41:08.321844 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:08.321828 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:41:09.796788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:09.796758 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerID="c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa" exitCode=0 Jul 02 23:41:09.797268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:09.796835 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" event={"ID":"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7","Type":"ContainerDied","Data":"c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa"} Jul 02 23:41:09.797382 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:09.797363 2578 scope.go:117] "RemoveContainer" containerID="c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa" Jul 02 23:41:09.798477 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:09.798450 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:41:09.798534 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:09.798521 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:41:09.798571 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:09.798555 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:41:10.312550 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:10.312515 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:10.413115 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:10.413083 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:10.699243 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:10.699198 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:41:10.803505 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:10.803470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" event={"ID":"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7","Type":"ContainerStarted","Data":"ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3"} Jul 02 23:41:11.020306 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:11.020270 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:41:11.021837 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:11.021804 2578 patch_prober.go:28] interesting pod/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 23:41:11.022083 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:11.022057 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 23:41:12.021246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:12.020773 2578 patch_prober.go:28] interesting pod/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 23:41:12.021246 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:12.020832 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 23:41:13.025368 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:13.025328 2578 patch_prober.go:28] interesting pod/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 23:41:13.025904 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:13.025409 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 23:41:14.020654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:14.020616 2578 patch_prober.go:28] interesting pod/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body= Jul 02 23:41:14.021001 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:14.020971 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" Jul 02 23:41:15.024768 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:15.024740 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:41:15.025153 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:15.025019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:41:15.025756 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:15.025742 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:41:18.854864 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:18.854817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:18.955530 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:18.955492 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:30.020568 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:30.020534 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:49.390863 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:49.390828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:50.294265 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:50.294221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:50.472713 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:50.472678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:50.861973 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:50.861941 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:50.962296 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:50.962262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:51.125623 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:51.125541 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:41:55.934336 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:41:55.934297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:07.799545 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:07.799502 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:08.019855 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.019815 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8"] Jul 02 23:42:08.020157 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.020108 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" containerID="cri-o://46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf" gracePeriod=30 Jul 02 23:42:08.043266 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.043213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:08.275250 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.275221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:08.324055 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.324020 2578 patch_prober.go:28] interesting pod/e2e-inf-a-d73038-openshift-default-c76df9-z84b8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 23:42:08.324216 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.324079 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 23:42:08.504480 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.504449 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:08.949963 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:08.949931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:09.050898 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:09.050858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:09.150919 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:09.150874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:09.274681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:09.274601 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:13.280330 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.280301 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:42:13.322753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322658 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d453fab7-b784-4e20-9498-8b6504449700-istio-podinfo\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.322753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322731 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ptck\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-kube-api-access-8ptck\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-certs\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322783 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-data\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322823 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-socket\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322848 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-credential-socket\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322909 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-envoy\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322943 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-istio-token\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323028 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.322982 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d453fab7-b784-4e20-9498-8b6504449700-istiod-ca-cert\") pod \"d453fab7-b784-4e20-9498-8b6504449700\" (UID: \"d453fab7-b784-4e20-9498-8b6504449700\") " Jul 02 23:42:13.323698 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.323587 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d453fab7-b784-4e20-9498-8b6504449700-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:42:13.323989 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.323949 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:13.324411 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.324312 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:13.324411 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.324388 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:13.324957 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.324922 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-data" (OuterVolumeSpecName: "istio-data") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:13.325421 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.325398 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-kube-api-access-8ptck" (OuterVolumeSpecName: "kube-api-access-8ptck") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "kube-api-access-8ptck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:13.325651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.325634 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d453fab7-b784-4e20-9498-8b6504449700-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:42:13.325940 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.325922 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-istio-token" (OuterVolumeSpecName: "istio-token") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:13.326129 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.326108 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d453fab7-b784-4e20-9498-8b6504449700" (UID: "d453fab7-b784-4e20-9498-8b6504449700"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:13.424538 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424501 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d453fab7-b784-4e20-9498-8b6504449700-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424538 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424537 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ptck\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-kube-api-access-8ptck\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424554 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424568 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424581 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424593 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424606 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d453fab7-b784-4e20-9498-8b6504449700-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424617 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d453fab7-b784-4e20-9498-8b6504449700-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:13.424738 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:13.424629 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d453fab7-b784-4e20-9498-8b6504449700-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:14.116643 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.116609 2578 generic.go:356] "Generic (PLEG): container finished" podID="d453fab7-b784-4e20-9498-8b6504449700" containerID="46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf" exitCode=0 Jul 02 23:42:14.116847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.116669 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" Jul 02 23:42:14.116847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.116693 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" event={"ID":"d453fab7-b784-4e20-9498-8b6504449700","Type":"ContainerDied","Data":"46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf"} Jul 02 23:42:14.116847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.116758 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8" event={"ID":"d453fab7-b784-4e20-9498-8b6504449700","Type":"ContainerDied","Data":"a53e11a0d00064e15ad5604318dc81221ac1d5fc4d7126f7bf7656a8d38a3483"} Jul 02 23:42:14.116847 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.116781 2578 scope.go:117] "RemoveContainer" containerID="46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf" Jul 02 23:42:14.126853 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.126831 2578 scope.go:117] "RemoveContainer" containerID="40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8" Jul 02 23:42:14.137645 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.137627 2578 scope.go:117] "RemoveContainer" containerID="46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf" Jul 02 23:42:14.138501 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:42:14.138357 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf\": container with ID starting with 46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf not found: ID does not exist" containerID="46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf" Jul 02 23:42:14.138501 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.138393 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf"} err="failed to get container status \"46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf\": rpc error: code = NotFound desc = could not find container \"46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf\": container with ID starting with 46f4e8bbf3a7dc3e1b988ce0bbdd55eeccd7d14dc65f855e7e5a74559038ebbf not found: ID does not exist" Jul 02 23:42:14.138501 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.138417 2578 scope.go:117] "RemoveContainer" containerID="40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8" Jul 02 23:42:14.138992 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:42:14.138969 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8\": container with ID starting with 40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8 not found: ID does not exist" containerID="40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8" Jul 02 23:42:14.139074 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.139000 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8"} err="failed to get container status \"40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8\": rpc error: code = NotFound desc = could not find container \"40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8\": container with ID starting with 40aef6d7d0ffa54a2d35a769d3bcea1052f7d341e023a366134bbc43fe964ab8 not found: ID does not exist" Jul 02 23:42:14.140070 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.140048 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8"] Jul 02 23:42:14.144678 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.144657 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d73038-openshift-default-c76df9-z84b8"] Jul 02 23:42:14.786937 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.786905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:14.887948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:14.887914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:15.016821 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:15.016784 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d453fab7-b784-4e20-9498-8b6504449700" path="/var/lib/kubelet/pods/d453fab7-b784-4e20-9498-8b6504449700/volumes" Jul 02 23:42:15.049428 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:15.049352 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5"] Jul 02 23:42:15.049581 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:15.049552 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" containerID="cri-o://ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3" gracePeriod=30 Jul 02 23:42:15.071752 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:15.071723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:15.338173 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:15.338088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:15.643066 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:15.642979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:15.965218 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:15.965175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:16.847183 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:16.847141 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:19.268591 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:19.268555 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:19.360856 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:19.360828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:19.448109 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:19.448070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:19.755715 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:19.755680 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:19.855393 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:19.855355 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:19.956350 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:19.956324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:20.307876 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.307854 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:42:20.396443 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396359 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-token\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396443 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396411 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-envoy\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396459 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-certs\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396484 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-credential-socket\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396511 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istiod-ca-cert\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396534 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-podinfo\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396565 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2dm5\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-kube-api-access-w2dm5\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396613 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-socket\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.396670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396663 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-data\") pod \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\" (UID: \"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7\") " Jul 02 23:42:20.397055 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396757 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:20.397055 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396790 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:20.397055 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.396911 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:42:20.397211 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.397122 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:20.397332 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.397312 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.397382 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.397338 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.397382 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.397354 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.397791 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.397766 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:20.398759 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.398733 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:20.398934 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.398912 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:42:20.399359 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.399340 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:20.399359 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.399347 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-kube-api-access-w2dm5" (OuterVolumeSpecName: "kube-api-access-w2dm5") pod "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" (UID: "4e5f19c6-9eec-4155-8ecd-c3bb178bfba7"). InnerVolumeSpecName "kube-api-access-w2dm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:20.498018 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.497986 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2dm5\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-kube-api-access-w2dm5\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.498018 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.498014 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.498018 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.498025 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.498251 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.498033 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.498251 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.498041 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:20.498251 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:20.498048 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:21.156444 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.156414 2578 generic.go:356] "Generic (PLEG): container finished" podID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerID="ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3" exitCode=0 Jul 02 23:42:21.156617 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.156448 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" event={"ID":"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7","Type":"ContainerDied","Data":"ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3"} Jul 02 23:42:21.156617 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.156469 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" Jul 02 23:42:21.156617 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.156491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5" event={"ID":"4e5f19c6-9eec-4155-8ecd-c3bb178bfba7","Type":"ContainerDied","Data":"7013d3ab65bad6bacc0acf17ea925ba293f6dc90184eac4d9584af2b3c13becc"} Jul 02 23:42:21.156617 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.156513 2578 scope.go:117] "RemoveContainer" containerID="ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3" Jul 02 23:42:21.165265 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.165244 2578 scope.go:117] "RemoveContainer" containerID="c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa" Jul 02 23:42:21.174768 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.174738 2578 scope.go:117] "RemoveContainer" containerID="ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3" Jul 02 23:42:21.174909 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.174851 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5"] Jul 02 23:42:21.175134 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:42:21.175109 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3\": container with ID starting with ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3 not found: ID does not exist" containerID="ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3" Jul 02 23:42:21.175256 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.175144 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3"} err="failed to get container status \"ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3\": rpc error: code = NotFound desc = could not find container \"ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3\": container with ID starting with ed6f7e49e38c1ef4de1e4c725390793a9fb13f83c78a5f2049d861cdd704e0c3 not found: ID does not exist" Jul 02 23:42:21.175256 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.175173 2578 scope.go:117] "RemoveContainer" containerID="c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa" Jul 02 23:42:21.175480 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:42:21.175461 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa\": container with ID starting with c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa not found: ID does not exist" containerID="c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa" Jul 02 23:42:21.175535 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.175487 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa"} err="failed to get container status \"c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa\": rpc error: code = NotFound desc = could not find container \"c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa\": container with ID starting with c2500cc755241fadc64d2a7058e74e620199266b9394ab3d03d62bf4c7ee30fa not found: ID does not exist" Jul 02 23:42:21.177073 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:21.177056 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8c4f9c-openshift-default-f64d4cf97-72vt5"] Jul 02 23:42:23.021037 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:23.021003 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" path="/var/lib/kubelet/pods/4e5f19c6-9eec-4155-8ecd-c3bb178bfba7/volumes" Jul 02 23:42:23.789467 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:23.789432 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:24.242098 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.242066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:24.542310 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542229 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm"] Jul 02 23:42:24.542626 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542614 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" Jul 02 23:42:24.542672 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542628 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" Jul 02 23:42:24.542672 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542639 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" Jul 02 23:42:24.542672 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542644 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" Jul 02 23:42:24.542672 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542658 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" Jul 02 23:42:24.542672 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542664 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" Jul 02 23:42:24.542672 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542672 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" Jul 02 23:42:24.542843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542678 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" Jul 02 23:42:24.542843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542733 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" Jul 02 23:42:24.542843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542744 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" Jul 02 23:42:24.542843 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.542751 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e5f19c6-9eec-4155-8ecd-c3bb178bfba7" containerName="istio-proxy" Jul 02 23:42:24.546356 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.546332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.548451 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.548428 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9ce355-openshift-default-dockercfg-8tdkr\"" Jul 02 23:42:24.558676 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.558654 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm"] Jul 02 23:42:24.572408 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.572382 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:24.636252 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-podinfo\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636320 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-data\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636435 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbpsk\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-kube-api-access-gbpsk\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636564 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-envoy\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636564 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-token\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636564 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istiod-ca-cert\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636564 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636534 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-socket\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636727 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-certs\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.636727 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.636599 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-credential-socket\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737451 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-podinfo\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-data\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpsk\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-kube-api-access-gbpsk\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-envoy\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-token\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istiod-ca-cert\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-socket\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-certs\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.737688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-credential-socket\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.738168 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.737933 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-data\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.738168 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.738085 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-credential-socket\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.738168 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.738095 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-socket\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.738300 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.738232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-certs\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.738579 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.738557 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istiod-ca-cert\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.740026 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.740004 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-envoy\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.740260 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.740242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-podinfo\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.753872 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.753849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-token\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.754858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.754840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbpsk\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-kube-api-access-gbpsk\") pod \"e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.858227 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.858132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:24.863137 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.863107 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:24.999822 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:24.999801 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm"] Jul 02 23:42:25.002197 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:42:25.002172 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27a8c4a_b332_4b4b_ba5f_84b93099094d.slice/crio-46c3383bbeda0f991980b2b2b49c0bf8a875be33c60d009124221c1a4b77ce96 WatchSource:0}: Error finding container 46c3383bbeda0f991980b2b2b49c0bf8a875be33c60d009124221c1a4b77ce96: Status 404 returned error can't find the container with id 46c3383bbeda0f991980b2b2b49c0bf8a875be33c60d009124221c1a4b77ce96 Jul 02 23:42:25.004228 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:25.004197 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:25.004323 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:25.004274 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:25.004323 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:25.004317 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:25.178663 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:25.178632 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" event={"ID":"f27a8c4a-b332-4b4b-ba5f-84b93099094d","Type":"ContainerStarted","Data":"c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650"} Jul 02 23:42:25.178875 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:25.178682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" event={"ID":"f27a8c4a-b332-4b4b-ba5f-84b93099094d","Type":"ContainerStarted","Data":"46c3383bbeda0f991980b2b2b49c0bf8a875be33c60d009124221c1a4b77ce96"} Jul 02 23:42:25.198547 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:25.198504 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" podStartSLOduration=1.198488527 podStartE2EDuration="1.198488527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:25.196616438 +0000 UTC m=+1872.675829199" watchObservedRunningTime="2026-07-02 23:42:25.198488527 +0000 UTC m=+1872.677701289" Jul 02 23:42:25.858674 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:25.858640 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:26.863747 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:26.863719 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:27.143599 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:27.143494 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:27.188701 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:27.188669 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:27.189579 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:27.189556 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:27.224128 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:27.224092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:27.349043 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:27.349005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:27.536321 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:27.536280 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:28.017899 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:28.017862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:28.119188 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:28.119145 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:31.624962 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:31.624926 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:39.681815 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:39.681715 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:40.082331 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:40.082237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:40.181939 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:40.181907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:40.290359 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:40.290322 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:40.456946 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:40.456912 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:42.583867 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:42.582733 2578 patch_prober.go:28] interesting pod/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:58518->10.134.0.39:15021: read: connection reset by peer" start-of-body= Jul 02 23:42:42.583867 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:42.582791 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:58518->10.134.0.39:15021: read: connection reset by peer" Jul 02 23:42:43.283185 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:43.283157 2578 generic.go:356] "Generic (PLEG): container finished" podID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerID="c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650" exitCode=0 Jul 02 23:42:43.283354 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:43.283201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" event={"ID":"f27a8c4a-b332-4b4b-ba5f-84b93099094d","Type":"ContainerDied","Data":"c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650"} Jul 02 23:42:43.283598 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:43.283584 2578 scope.go:117] "RemoveContainer" containerID="c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650" Jul 02 23:42:43.284601 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:43.284574 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:43.284654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:43.284640 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:43.284690 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:43.284671 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:44.289658 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:44.289626 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" event={"ID":"f27a8c4a-b332-4b4b-ba5f-84b93099094d","Type":"ContainerStarted","Data":"b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f"} Jul 02 23:42:44.859336 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:44.859294 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:44.859547 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:44.859525 2578 patch_prober.go:28] interesting pod/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 23:42:44.859599 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:44.859573 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 23:42:45.859070 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:45.859034 2578 patch_prober.go:28] interesting pod/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 23:42:45.859554 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:45.859096 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 23:42:45.919672 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:45.919634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:46.020709 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:46.020659 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:46.194903 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:46.194838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:46.407315 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:46.407286 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:46.588268 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:46.588180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:46.859554 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:46.859469 2578 patch_prober.go:28] interesting pod/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 23:42:46.859960 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:46.859553 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 23:42:47.011853 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:47.011812 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:47.209261 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:47.209229 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:47.310654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:47.310619 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:47.479991 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:47.479904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:47.858716 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:47.858621 2578 patch_prober.go:28] interesting pod/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 02 23:42:47.858716 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:47.858682 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 02 23:42:48.862537 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:48.862509 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:48.862999 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:48.862847 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:48.863652 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:48.863633 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:52.747494 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:52.747458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:52.849016 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:52.848987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:52.990649 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:52.990617 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm"] Jul 02 23:42:52.990963 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:52.990930 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" containerID="cri-o://b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f" gracePeriod=30 Jul 02 23:42:53.014708 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.014620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:53.231658 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.231618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:53.560874 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.560840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:53.856033 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.855956 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv"] Jul 02 23:42:53.856602 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.856584 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d453fab7-b784-4e20-9498-8b6504449700" containerName="istio-proxy" Jul 02 23:42:53.859774 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.859754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.861933 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.861912 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9d43a8-openshift-default-dockercfg-j74sr\"" Jul 02 23:42:53.870423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.870403 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv"] Jul 02 23:42:53.878920 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.878898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:53.930793 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.930766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istiod-ca-cert\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.930950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.930813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-socket\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.930950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.930832 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-token\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.930950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.930853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-credential-socket\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.930950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.930897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-data\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.930950 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.930914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-envoy\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.931163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.930973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-certs\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.931163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.931004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-podinfo\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.931163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.931024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4x6s\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-kube-api-access-s4x6s\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:53.979209 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:53.979181 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:54.032148 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istiod-ca-cert\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032342 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032238 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-socket\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032342 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-token\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032342 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-credential-socket\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032541 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-data\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032541 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-envoy\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032541 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-certs\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032541 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-podinfo\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.032541 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.032486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4x6s\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-kube-api-access-s4x6s\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.033050 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.033021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istiod-ca-cert\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.033213 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.033187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-data\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.033293 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.033246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-socket\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.033534 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.033511 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-certs\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.033764 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.033740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-credential-socket\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.035960 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.035916 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-envoy\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.036541 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.036516 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-podinfo\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.047144 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.047095 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4x6s\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-kube-api-access-s4x6s\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.048217 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.048193 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-token\") pod \"e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.170361 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.170275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:54.311624 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.311574 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv"] Jul 02 23:42:54.314149 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:42:54.314120 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc800b3b8_2c9d_4c44_89b3_20f1bce5444f.slice/crio-c8ff5af6250c0419e2c5727e5069d064c6eb056d22da4eafb5bcf714b2986954 WatchSource:0}: Error finding container c8ff5af6250c0419e2c5727e5069d064c6eb056d22da4eafb5bcf714b2986954: Status 404 returned error can't find the container with id c8ff5af6250c0419e2c5727e5069d064c6eb056d22da4eafb5bcf714b2986954 Jul 02 23:42:54.316240 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.316211 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:54.316332 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.316275 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:54.316332 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.316306 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:42:54.339746 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:54.339724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" event={"ID":"c800b3b8-2c9d-4c44-89b3-20f1bce5444f","Type":"ContainerStarted","Data":"c8ff5af6250c0419e2c5727e5069d064c6eb056d22da4eafb5bcf714b2986954"} Jul 02 23:42:55.345735 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:55.345698 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" event={"ID":"c800b3b8-2c9d-4c44-89b3-20f1bce5444f","Type":"ContainerStarted","Data":"5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f"} Jul 02 23:42:55.366244 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:55.366198 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" podStartSLOduration=2.366183421 podStartE2EDuration="2.366183421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:42:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:42:55.363797454 +0000 UTC m=+1902.843010216" watchObservedRunningTime="2026-07-02 23:42:55.366183421 +0000 UTC m=+1902.845396250" Jul 02 23:42:56.170723 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:56.170689 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:56.175170 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:56.175146 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:56.356816 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:56.356781 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:56.357735 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:56.357714 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:42:57.278237 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:57.278198 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:57.381363 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:57.381321 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:57.454683 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:57.454647 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:57.552331 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:57.552245 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:57.850173 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:57.850088 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:57.950757 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:57.950719 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:42:58.276177 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.276155 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:58.369986 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.369864 2578 generic.go:356] "Generic (PLEG): container finished" podID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerID="b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f" exitCode=0 Jul 02 23:42:58.369986 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.369948 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" Jul 02 23:42:58.369986 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.369956 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" event={"ID":"f27a8c4a-b332-4b4b-ba5f-84b93099094d","Type":"ContainerDied","Data":"b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f"} Jul 02 23:42:58.370235 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.370003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm" event={"ID":"f27a8c4a-b332-4b4b-ba5f-84b93099094d","Type":"ContainerDied","Data":"46c3383bbeda0f991980b2b2b49c0bf8a875be33c60d009124221c1a4b77ce96"} Jul 02 23:42:58.370235 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.370029 2578 scope.go:117] "RemoveContainer" containerID="b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f" Jul 02 23:42:58.378511 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378484 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-data\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.378667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378554 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-credential-socket\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.378667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378601 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbpsk\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-kube-api-access-gbpsk\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.378667 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378637 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-certs\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.378825 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378705 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-envoy\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.378825 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378732 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istiod-ca-cert\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.378825 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378793 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-podinfo\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.378825 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-socket\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.379047 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.378856 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-token\") pod \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\" (UID: \"f27a8c4a-b332-4b4b-ba5f-84b93099094d\") " Jul 02 23:42:58.379647 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.379303 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:58.380303 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.380132 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-data" (OuterVolumeSpecName: "istio-data") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:58.380407 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.380353 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:58.380479 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.380397 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:42:58.380655 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.380635 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:58.382572 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.382528 2578 scope.go:117] "RemoveContainer" containerID="c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650" Jul 02 23:42:58.382974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.382608 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-token" (OuterVolumeSpecName: "istio-token") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:58.382974 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.382935 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:42:58.383091 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.383048 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:42:58.383220 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.383199 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-kube-api-access-gbpsk" (OuterVolumeSpecName: "kube-api-access-gbpsk") pod "f27a8c4a-b332-4b4b-ba5f-84b93099094d" (UID: "f27a8c4a-b332-4b4b-ba5f-84b93099094d"). InnerVolumeSpecName "kube-api-access-gbpsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:42:58.401210 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.401189 2578 scope.go:117] "RemoveContainer" containerID="b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f" Jul 02 23:42:58.401583 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:42:58.401564 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f\": container with ID starting with b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f not found: ID does not exist" containerID="b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f" Jul 02 23:42:58.401651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.401591 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f"} err="failed to get container status \"b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f\": rpc error: code = NotFound desc = could not find container \"b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f\": container with ID starting with b32017430c7ad260d238396c902c445060a7588a3ad389d6109f681cf87f410f not found: ID does not exist" Jul 02 23:42:58.401651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.401608 2578 scope.go:117] "RemoveContainer" containerID="c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650" Jul 02 23:42:58.401944 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:42:58.401869 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650\": container with ID starting with c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650 not found: ID does not exist" containerID="c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650" Jul 02 23:42:58.402015 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.401955 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650"} err="failed to get container status \"c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650\": rpc error: code = NotFound desc = could not find container \"c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650\": container with ID starting with c20261dde2d2211a2132848a25ae40b53d6f70de70db55a647cb687a7c39f650 not found: ID does not exist" Jul 02 23:42:58.480089 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480052 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480089 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480083 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbpsk\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-kube-api-access-gbpsk\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480098 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480112 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480125 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480138 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480151 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480165 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.480287 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.480179 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f27a8c4a-b332-4b4b-ba5f-84b93099094d-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:42:58.691020 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.690987 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm"] Jul 02 23:42:58.696446 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:58.696425 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9ce355-openshift-default-58f86d755c-lvstm"] Jul 02 23:42:59.016386 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:42:59.016299 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" path="/var/lib/kubelet/pods/f27a8c4a-b332-4b4b-ba5f-84b93099094d/volumes" Jul 02 23:43:01.787278 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:01.787237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:02.194026 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:02.193995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:02.457982 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:02.457304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:02.666299 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:02.666264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:05.532514 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:05.532468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:05.631384 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:05.631347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:05.748496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:05.748456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:06.310765 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:06.310682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:06.411273 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:06.411228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:09.432989 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:09.432954 2578 generic.go:356] "Generic (PLEG): container finished" podID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerID="5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f" exitCode=0 Jul 02 23:43:09.433469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:09.433032 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" event={"ID":"c800b3b8-2c9d-4c44-89b3-20f1bce5444f","Type":"ContainerDied","Data":"5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f"} Jul 02 23:43:09.433469 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:09.433447 2578 scope.go:117] "RemoveContainer" containerID="5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f" Jul 02 23:43:09.434573 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:09.434538 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:43:09.434651 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:09.434626 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:43:09.434695 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:09.434663 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 02 23:43:10.039203 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:10.039167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:10.443928 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:10.443868 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" event={"ID":"c800b3b8-2c9d-4c44-89b3-20f1bce5444f","Type":"ContainerStarted","Data":"dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8"} Jul 02 23:43:11.171288 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:11.171246 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:43:11.172412 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:11.172389 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 23:43:11.172524 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:11.172457 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 23:43:11.357121 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:11.357090 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:43:12.170618 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:12.170586 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 23:43:12.171029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:12.170655 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 23:43:12.298580 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:12.298513 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:13.171496 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:13.171456 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 23:43:13.171865 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:13.171511 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 23:43:14.171238 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:14.171198 2578 patch_prober.go:28] interesting pod/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 02 23:43:14.171447 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:14.171274 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 02 23:43:15.175029 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:15.174996 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:43:15.176196 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:15.176168 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:43:19.468664 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:19.468627 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:19.568720 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:19.568686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:27.782377 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:27.782337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:27.894356 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:27.894322 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:31.029352 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:31.029319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:39.523931 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:39.523862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:42.789698 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:42.789661 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:42.839064 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:42.839026 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:48.344396 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:48.344295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:49.392333 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:49.392300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:43:49.494503 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:43:49.494470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:45:32.185046 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:45:32.185008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:45:33.377983 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:45:33.377938 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:45:35.678091 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:45:35.678052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:46:18.514441 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:46:18.514406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:46:44.055604 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:46:44.055565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:47:01.609216 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:47:01.609179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:47:02.419853 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:47:02.419816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:47:15.795212 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:47:15.795121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:02.315051 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:02.315012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:20.339719 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:20.339676 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:20.438789 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:20.438752 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:28.566343 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:28.566299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:28.671840 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:28.671778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:50.100066 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:50.100029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:50.200654 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:50.200610 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:55.275177 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:55.275130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:56.100961 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:56.100925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:57.224281 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:57.224239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:57.645701 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:57.645609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:57.746008 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:57.745967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:57.873425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:57.873392 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:48:58.024440 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:48:58.024409 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:02.727968 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:02.727930 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:39.605089 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:39.605032 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:39.868400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:39.868313 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv"] Jul 02 23:49:39.868586 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:39.868559 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" containerID="cri-o://dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8" gracePeriod=30 Jul 02 23:49:39.888906 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:39.888860 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:40.129163 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:40.129070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:40.295470 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:40.295437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:40.718378 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:40.718341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:40.819316 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:40.819284 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:40.919410 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:40.919354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:41.068194 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:41.068101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:45.129576 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.129507 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:49:45.271013 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.270976 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-certs\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271026 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-envoy\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271086 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-credential-socket\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271119 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-data\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271181 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-token\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271204 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4x6s\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-kube-api-access-s4x6s\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271240 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-socket\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271248 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:49:45.271423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271292 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-podinfo\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271423 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271347 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istiod-ca-cert\") pod \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\" (UID: \"c800b3b8-2c9d-4c44-89b3-20f1bce5444f\") " Jul 02 23:49:45.271670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271427 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:49:45.271670 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271514 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:49:45.271788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271727 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.271788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271747 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-workload-certs\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.271788 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271762 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-credential-socket\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.271992 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.271836 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 23:49:45.272400 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.272363 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:49:45.273634 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.273592 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:49:45.273739 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.273690 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 23:49:45.273959 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.273934 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-kube-api-access-s4x6s" (OuterVolumeSpecName: "kube-api-access-s4x6s") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "kube-api-access-s4x6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 23:49:45.273959 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.273937 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c800b3b8-2c9d-4c44-89b3-20f1bce5444f" (UID: "c800b3b8-2c9d-4c44-89b3-20f1bce5444f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 23:49:45.373198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.373165 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-podinfo\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.373198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.373191 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istiod-ca-cert\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.373198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.373201 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-envoy\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.373198 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.373208 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-data\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.373456 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.373216 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-istio-token\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.373456 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.373224 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4x6s\" (UniqueName: \"kubernetes.io/projected/c800b3b8-2c9d-4c44-89b3-20f1bce5444f-kube-api-access-s4x6s\") on node \"ip-10-0-132-236.ec2.internal\" DevicePath \"\"" Jul 02 23:49:45.399086 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.399012 2578 generic.go:356] "Generic (PLEG): container finished" podID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerID="dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8" exitCode=0 Jul 02 23:49:45.399086 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.399070 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" Jul 02 23:49:45.399234 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.399096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" event={"ID":"c800b3b8-2c9d-4c44-89b3-20f1bce5444f","Type":"ContainerDied","Data":"dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8"} Jul 02 23:49:45.399234 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.399150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv" event={"ID":"c800b3b8-2c9d-4c44-89b3-20f1bce5444f","Type":"ContainerDied","Data":"c8ff5af6250c0419e2c5727e5069d064c6eb056d22da4eafb5bcf714b2986954"} Jul 02 23:49:45.399234 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.399177 2578 scope.go:117] "RemoveContainer" containerID="dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8" Jul 02 23:49:45.408696 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.408677 2578 scope.go:117] "RemoveContainer" containerID="5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f" Jul 02 23:49:45.416443 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.416424 2578 scope.go:117] "RemoveContainer" containerID="dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8" Jul 02 23:49:45.416689 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:49:45.416668 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8\": container with ID starting with dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8 not found: ID does not exist" containerID="dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8" Jul 02 23:49:45.416765 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.416702 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8"} err="failed to get container status \"dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8\": rpc error: code = NotFound desc = could not find container \"dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8\": container with ID starting with dbe9cb4738f5af068874d8f7f0e15711b84b9f984a7e46c82f97d7f897c442b8 not found: ID does not exist" Jul 02 23:49:45.416765 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.416724 2578 scope.go:117] "RemoveContainer" containerID="5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f" Jul 02 23:49:45.416965 ip-10-0-132-236 kubenswrapper[2578]: E0702 23:49:45.416947 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f\": container with ID starting with 5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f not found: ID does not exist" containerID="5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f" Jul 02 23:49:45.417018 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.416974 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f"} err="failed to get container status \"5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f\": rpc error: code = NotFound desc = could not find container \"5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f\": container with ID starting with 5bc0c54ed8d9699b749a6f8b3cd5a6de46007164c3a62e68a2c684713542bf2f not found: ID does not exist" Jul 02 23:49:45.419933 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.419909 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv"] Jul 02 23:49:45.430279 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:45.430254 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9d43a8-openshift-default-5946d6444c-wxsmv"] Jul 02 23:49:46.672615 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:46.672579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:46.773383 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:46.773344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:46.940721 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:46.940630 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:47.018033 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:47.017999 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" path="/var/lib/kubelet/pods/c800b3b8-2c9d-4c44-89b3-20f1bce5444f/volumes" Jul 02 23:49:47.260984 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:47.260865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:49:53.205179 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:53.205150 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-pht49_693dfb54-233d-44c1-b85c-0187af57337d/copy-manifests/0.log" Jul 02 23:49:53.223056 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:53.223033 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-pht49_693dfb54-233d-44c1-b85c-0187af57337d/manager/0.log" Jul 02 23:49:55.446100 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:55.446064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k5twp_c3ae8403-2fbb-4e7d-b83c-1f8539b0a809/manager/0.log" Jul 02 23:49:56.038335 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:56.038304 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jkc_6920b345-8266-453c-8e1c-65aaa4cef0c8/istio-proxy/0.log" Jul 02 23:49:56.161352 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:56.161317 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-24dhj_31412cba-b3b0-4bd1-9534-93a0a3909b6d/discovery/0.log" Jul 02 23:49:56.627945 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:56.627908 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-6vjfh_40658ecb-7f59-49dd-a2a1-7ad172b337de/payload-pre-processing/0.log" Jul 02 23:49:57.195695 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:57.195670 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kgj28_d4267b34-4373-4daf-b939-bba1cb0c0ef4/main/0.log" Jul 02 23:49:57.542692 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:49:57.542612 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dblv2fw_93bcb09e-3532-46eb-86ad-94d493f16e55/main/0.log" Jul 02 23:50:01.915688 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:01.915636 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:50:01.974682 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:01.974645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" limit=1024 Jul 02 23:50:04.939748 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:04.939671 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wvx8s_7a38af0d-67d8-4b5f-bdaf-338dd91be602/global-pull-secret-syncer/0.log" Jul 02 23:50:04.992724 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:04.992696 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5ps4z_2c000021-9827-44c9-bc41-7455ba95f79e/konnectivity-agent/0.log" Jul 02 23:50:05.078524 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:05.078485 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-236.ec2.internal_18bcd73158ca1a5b1c82fc4d26d8e309/haproxy/0.log" Jul 02 23:50:10.428534 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:10.428489 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-k5twp_c3ae8403-2fbb-4e7d-b83c-1f8539b0a809/manager/0.log" Jul 02 23:50:12.205662 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.205631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11c1acf6-e59d-4849-9ddf-c2a618cf99d4/alertmanager/0.log" Jul 02 23:50:12.227526 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.227503 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11c1acf6-e59d-4849-9ddf-c2a618cf99d4/config-reloader/0.log" Jul 02 23:50:12.248866 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.248835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11c1acf6-e59d-4849-9ddf-c2a618cf99d4/kube-rbac-proxy-web/0.log" Jul 02 23:50:12.270828 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.270804 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11c1acf6-e59d-4849-9ddf-c2a618cf99d4/kube-rbac-proxy/0.log" Jul 02 23:50:12.294485 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.294460 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11c1acf6-e59d-4849-9ddf-c2a618cf99d4/kube-rbac-proxy-metric/0.log" Jul 02 23:50:12.318914 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.318896 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11c1acf6-e59d-4849-9ddf-c2a618cf99d4/prom-label-proxy/0.log" Jul 02 23:50:12.341653 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.341632 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_11c1acf6-e59d-4849-9ddf-c2a618cf99d4/init-config-reloader/0.log" Jul 02 23:50:12.419215 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.419182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jz85h_beab0178-556e-45d2-afe0-8251cf279440/kube-state-metrics/0.log" Jul 02 23:50:12.437425 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.437398 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jz85h_beab0178-556e-45d2-afe0-8251cf279440/kube-rbac-proxy-main/0.log" Jul 02 23:50:12.457660 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.457602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-jz85h_beab0178-556e-45d2-afe0-8251cf279440/kube-rbac-proxy-self/0.log" Jul 02 23:50:12.483609 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.483586 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-79f4d94c66-6c77k_ea67b982-58ff-44e4-83d0-ec7eae29f0bf/metrics-server/0.log" Jul 02 23:50:12.508853 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.508824 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-kdczx_8144f00f-89a5-4ab6-9698-a7f77ce32dd6/monitoring-plugin/0.log" Jul 02 23:50:12.643436 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.643405 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwl68_1a938782-ad0d-4e31-9df9-39f888178f07/node-exporter/0.log" Jul 02 23:50:12.662948 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.662925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwl68_1a938782-ad0d-4e31-9df9-39f888178f07/kube-rbac-proxy/0.log" Jul 02 23:50:12.682157 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.682133 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwl68_1a938782-ad0d-4e31-9df9-39f888178f07/init-textfile/0.log" Jul 02 23:50:12.798238 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.798160 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-kdbwh_15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa/kube-rbac-proxy-main/0.log" Jul 02 23:50:12.819303 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.819265 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-kdbwh_15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa/kube-rbac-proxy-self/0.log" Jul 02 23:50:12.843041 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.843009 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-kdbwh_15e0cfa7-cd5b-48ad-84f6-9bceb2c05baa/openshift-state-metrics/0.log" Jul 02 23:50:12.878533 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.878500 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f18412e4-13f7-40c7-b333-57b0ef017614/prometheus/0.log" Jul 02 23:50:12.905444 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.905413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f18412e4-13f7-40c7-b333-57b0ef017614/config-reloader/0.log" Jul 02 23:50:12.933356 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.933333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f18412e4-13f7-40c7-b333-57b0ef017614/thanos-sidecar/0.log" Jul 02 23:50:12.953546 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.953524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f18412e4-13f7-40c7-b333-57b0ef017614/kube-rbac-proxy-web/0.log" Jul 02 23:50:12.974951 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.974916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f18412e4-13f7-40c7-b333-57b0ef017614/kube-rbac-proxy/0.log" Jul 02 23:50:12.995550 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:12.995528 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f18412e4-13f7-40c7-b333-57b0ef017614/kube-rbac-proxy-thanos/0.log" Jul 02 23:50:13.019323 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.019300 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f18412e4-13f7-40c7-b333-57b0ef017614/init-config-reloader/0.log" Jul 02 23:50:13.054753 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.054677 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7tqvl_3110f218-a042-4cb3-bf9f-553407becd7e/prometheus-operator/0.log" Jul 02 23:50:13.083817 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.083788 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7tqvl_3110f218-a042-4cb3-bf9f-553407becd7e/kube-rbac-proxy/0.log" Jul 02 23:50:13.142766 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.142730 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-577ff544ff-q6hrc_76a303c3-1810-4491-ba98-628bdf8db462/telemeter-client/0.log" Jul 02 23:50:13.164595 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.164564 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-577ff544ff-q6hrc_76a303c3-1810-4491-ba98-628bdf8db462/reload/0.log" Jul 02 23:50:13.186676 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.186650 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-577ff544ff-q6hrc_76a303c3-1810-4491-ba98-628bdf8db462/kube-rbac-proxy/0.log" Jul 02 23:50:13.216921 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.216897 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-574db4cbc9-q4frf_1f569501-9196-45e4-b2d0-c50ddd4bd231/thanos-query/0.log" Jul 02 23:50:13.238267 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.238236 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-574db4cbc9-q4frf_1f569501-9196-45e4-b2d0-c50ddd4bd231/kube-rbac-proxy-web/0.log" Jul 02 23:50:13.258858 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.258834 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-574db4cbc9-q4frf_1f569501-9196-45e4-b2d0-c50ddd4bd231/kube-rbac-proxy/0.log" Jul 02 23:50:13.280918 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.280895 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-574db4cbc9-q4frf_1f569501-9196-45e4-b2d0-c50ddd4bd231/prom-label-proxy/0.log" Jul 02 23:50:13.309431 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.309353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-574db4cbc9-q4frf_1f569501-9196-45e4-b2d0-c50ddd4bd231/kube-rbac-proxy-rules/0.log" Jul 02 23:50:13.331994 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:13.331958 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-574db4cbc9-q4frf_1f569501-9196-45e4-b2d0-c50ddd4bd231/kube-rbac-proxy-metrics/0.log" Jul 02 23:50:14.375141 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375106 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn"] Jul 02 23:50:14.375681 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375661 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" Jul 02 23:50:14.375771 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375687 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" Jul 02 23:50:14.375771 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375704 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" Jul 02 23:50:14.375771 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375713 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" Jul 02 23:50:14.375771 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375731 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" Jul 02 23:50:14.375771 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375740 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" Jul 02 23:50:14.376052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375856 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" Jul 02 23:50:14.376052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375874 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27a8c4a-b332-4b4b-ba5f-84b93099094d" containerName="istio-proxy" Jul 02 23:50:14.376052 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.375903 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c800b3b8-2c9d-4c44-89b3-20f1bce5444f" containerName="istio-proxy" Jul 02 23:50:14.380454 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.380430 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.383014 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.382994 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vvcqv\"/\"kube-root-ca.crt\"" Jul 02 23:50:14.383555 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.383539 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vvcqv\"/\"openshift-service-ca.crt\"" Jul 02 23:50:14.383603 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.383547 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vvcqv\"/\"default-dockercfg-jlszs\"" Jul 02 23:50:14.390128 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.390100 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn"] Jul 02 23:50:14.441769 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.441736 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-proc\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.441923 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.441790 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-podres\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.441923 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.441816 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-lib-modules\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.441923 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.441839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-sys\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.441923 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.441872 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44zts\" (UniqueName: \"kubernetes.io/projected/50abc836-7886-4add-a4da-c31d3fdd197e-kube-api-access-44zts\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.542630 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-proc\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.542792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542659 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-podres\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.542792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-lib-modules\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.542792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542700 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-sys\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.542792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542729 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-proc\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.542792 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44zts\" (UniqueName: \"kubernetes.io/projected/50abc836-7886-4add-a4da-c31d3fdd197e-kube-api-access-44zts\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.543149 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542823 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-lib-modules\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.543149 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-podres\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.543149 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.542873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50abc836-7886-4add-a4da-c31d3fdd197e-sys\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.551515 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.551489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44zts\" (UniqueName: \"kubernetes.io/projected/50abc836-7886-4add-a4da-c31d3fdd197e-kube-api-access-44zts\") pod \"perf-node-gather-daemonset-sdrnn\" (UID: \"50abc836-7886-4add-a4da-c31d3fdd197e\") " pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.691271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.691236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:14.826458 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:14.826432 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn"] Jul 02 23:50:14.829086 ip-10-0-132-236 kubenswrapper[2578]: W0702 23:50:14.829056 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod50abc836_7886_4add_a4da_c31d3fdd197e.slice/crio-ea28eae196d84072dc82a6099c87f2f0809515e2187d878b818e033ec26b2658 WatchSource:0}: Error finding container ea28eae196d84072dc82a6099c87f2f0809515e2187d878b818e033ec26b2658: Status 404 returned error can't find the container with id ea28eae196d84072dc82a6099c87f2f0809515e2187d878b818e033ec26b2658 Jul 02 23:50:15.550271 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:15.550236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" event={"ID":"50abc836-7886-4add-a4da-c31d3fdd197e","Type":"ContainerStarted","Data":"394153fe582920fb0364744716f59979d7469ebba3445dd1345e496394a1a02f"} Jul 02 23:50:15.550686 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:15.550290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" event={"ID":"50abc836-7886-4add-a4da-c31d3fdd197e","Type":"ContainerStarted","Data":"ea28eae196d84072dc82a6099c87f2f0809515e2187d878b818e033ec26b2658"} Jul 02 23:50:15.550686 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:15.550355 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:15.566515 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:15.566461 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" podStartSLOduration=1.566441816 podStartE2EDuration="1.566441816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:50:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:50:15.565808787 +0000 UTC m=+2343.045021550" watchObservedRunningTime="2026-07-02 23:50:15.566441816 +0000 UTC m=+2343.045654579" Jul 02 23:50:17.284559 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:17.284530 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-858xz_e8364921-698b-472d-b26a-aa4b52faeb73/dns/0.log" Jul 02 23:50:17.308365 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:17.308332 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-858xz_e8364921-698b-472d-b26a-aa4b52faeb73/kube-rbac-proxy/0.log" Jul 02 23:50:17.412068 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:17.412035 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qvk4m_cb215e73-0ebf-455c-8c7a-7e18ab49c45d/dns-node-resolver/0.log" Jul 02 23:50:18.052337 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:18.052306 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vvr6x_7f07ae0a-5a5c-4998-8b55-4c58e4a32223/node-ca/0.log" Jul 02 23:50:18.976593 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:18.976555 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jkc_6920b345-8266-453c-8e1c-65aaa4cef0c8/istio-proxy/0.log" Jul 02 23:50:19.164378 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:19.164351 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-24dhj_31412cba-b3b0-4bd1-9534-93a0a3909b6d/discovery/0.log" Jul 02 23:50:19.300460 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:19.300387 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-6vjfh_40658ecb-7f59-49dd-a2a1-7ad172b337de/payload-pre-processing/0.log" Jul 02 23:50:20.080918 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:20.080869 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nwg5j_4a905999-632d-4f54-9d61-1f709070a358/serve-healthcheck-canary/0.log" Jul 02 23:50:20.580417 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:20.580380 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bf5n8_aa0dbb1b-ade4-49c3-af59-779c6e457dd4/kube-rbac-proxy/0.log" Jul 02 23:50:20.600663 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:20.600636 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bf5n8_aa0dbb1b-ade4-49c3-af59-779c6e457dd4/exporter/0.log" Jul 02 23:50:20.621854 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:20.621829 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bf5n8_aa0dbb1b-ade4-49c3-af59-779c6e457dd4/extractor/0.log" Jul 02 23:50:21.565660 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:21.565632 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vvcqv/perf-node-gather-daemonset-sdrnn" Jul 02 23:50:23.464692 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:23.464663 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-pht49_693dfb54-233d-44c1-b85c-0187af57337d/manager/0.log" Jul 02 23:50:23.480864 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:23.480846 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d98bc9d58-pht49_693dfb54-233d-44c1-b85c-0187af57337d/copy-manifests/0.log" Jul 02 23:50:24.872497 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:24.872468 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jkc_6920b345-8266-453c-8e1c-65aaa4cef0c8/istio-proxy/0.log" Jul 02 23:50:25.006647 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:25.006619 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-747bc6df4d-nfdf4_ee0719f4-5737-409e-985d-fc851016edce/manager/0.log" Jul 02 23:50:25.055291 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:25.055264 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-24dhj_31412cba-b3b0-4bd1-9534-93a0a3909b6d/discovery/0.log" Jul 02 23:50:25.155160 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:25.155067 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-6vjfh_40658ecb-7f59-49dd-a2a1-7ad172b337de/payload-pre-processing/0.log" Jul 02 23:50:26.375735 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:26.375704 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf448jkc_6920b345-8266-453c-8e1c-65aaa4cef0c8/istio-proxy/0.log" Jul 02 23:50:26.564669 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:26.564643 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-24dhj_31412cba-b3b0-4bd1-9534-93a0a3909b6d/discovery/0.log" Jul 02 23:50:26.669144 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:26.669055 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-6vjfh_40658ecb-7f59-49dd-a2a1-7ad172b337de/payload-pre-processing/0.log" Jul 02 23:50:31.287058 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.287026 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6442c_a1ab398b-68ab-46c0-ac42-2b0ff3b98c3d/kube-multus/0.log" Jul 02 23:50:31.309075 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.309048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mwlf_17aaa165-6fc7-48c2-9e48-4886fe694b80/kube-multus-additional-cni-plugins/0.log" Jul 02 23:50:31.331860 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.331835 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mwlf_17aaa165-6fc7-48c2-9e48-4886fe694b80/egress-router-binary-copy/0.log" Jul 02 23:50:31.356814 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.356789 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mwlf_17aaa165-6fc7-48c2-9e48-4886fe694b80/cni-plugins/0.log" Jul 02 23:50:31.376675 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.376650 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mwlf_17aaa165-6fc7-48c2-9e48-4886fe694b80/bond-cni-plugin/0.log" Jul 02 23:50:31.395921 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.395873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mwlf_17aaa165-6fc7-48c2-9e48-4886fe694b80/routeoverride-cni/0.log" Jul 02 23:50:31.415393 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.415370 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mwlf_17aaa165-6fc7-48c2-9e48-4886fe694b80/whereabouts-cni-bincopy/0.log" Jul 02 23:50:31.434502 ip-10-0-132-236 kubenswrapper[2578]: I0702 23:50:31.434478 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mwlf_17aaa165-6fc7-48c2-9e48-4886fe694b80/whereabouts-cni/0.log"